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In this note we explicitly work out the precise relationship between Ext groups and 
massless modes of D-branes wrapped on complex submanifolds of Calabi-Yau manifolds. 
Specifically, we explicitly compute the boundary vertex operators for massless Ramond sec- 
tor states, in open string B models describing Calabi-Yau manifolds at large radius, directly 
in BCFT using standard methods. Naively these vertex operators are in one-to-one cor- 
respondence with certain sheaf cohomology groups (as is typical for such vertex operator 
calculations), which are related to the desired Ext groups via spectral sequences. However, 
a subtlety in the physics of the open string B model has the effect of physically realizing 
those spectral sequences in BRST cohomology, so that the vertex operators are actually 
in one-to-one correspondence with Ext group elements. This gives an extremely concrete 
physical test of recent proposals regarding the relationship between derived categories and 
D-branes. The Freed- Witten anomaly also plays an important role in these calculations, and 
we are now able to completely reconcile that anomaly with the derived categories program 
generally. We check these results extensively in numerous examples, and comment on several 
related issues. 
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1 Introduction 



Recently it has become fashionable to use derived categories as a tool to study D-branes 
wrapped on complex submanifolds of Calabi-Yau spaces. Derived categories are now believed 
to have a direct physical interpretation, via a number of rather formal arguments. (See 
[1, 2, 3, 4] for an incomplete list of early references on this subject.) 

One prediction of this derived categories program is that massless states of open strings 
between D-branes wrapped on complex submanifolds of Calabi-Yau spaces should be related 
to certain mathematical objects known as Ext groups. For those readers not familiar with 
such technology, Ext groups are analogous to cohomology groups, and are defined with 
respect to two coherent sheaves. The usual notation is 

Ext^ (S 1 ,S 2 ) 

where S±, S2 are two coherent sheaves on X and n is an integer. Phrased in this language, 
if we have one D-brane wrapped on a complex submanifold i : S X with holomorphic 
vector bundle £ on S and another D-brane wrapped on a complex submanifold j : T X 
with holomorphic vector bundle JF on T, then the prediction in question is that massless 
states of open strings between these D-branes should be counted by groups denoted 

Ext^ (i*£,j*F) 

and 

Ext^ (j+FiUS) 

(depending upon the orientation of the open string). 

This mathematically natural prediction has been checked in a number of special cases. 
For example, in the trivial case that both branes are wrapped on the entire Calabi-Yau, the 
result is easily checked to be true. See [5] for a discussion of the special case C 3 /Z 3 . Also see 
[6] for a self-consistency test of this hypothesis in the special case of the quintic. Additional 
special cases have also been checked [7]. 

Also note this prediction is closely analogous to some well-known results in heterotic 
compactifications. In heterotic compactifications involving gauge sheaves that are not bun- 
dles [8], it has been shown [9, 10] that massless modes are counted by Ext groups, replacing 
the sheaf cohomology groups that count the massless modes when the gauge sheaves are 
honest bundles [11]. Similarly, in the trivial case that the wrapped D-branes are wrapped 
on the entire Calabi-Yau, the Ext groups reduce to sheaf cohomology. The prediction that 
states are counted by Ext groups is equivalent to the statement that for more general brane 
configurations than the trivial one, sheaf cohomology is replaced by Ext groups, which is 
certainly what happened in heterotic compactifications. 
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However, there has not, to our knowledge, been any systematic attempt to check directly 
in BCFT that open string states between appropriate D-branes are always related to Ext 
groups. In particular, the general correspondence between BCFT vertex operators and Ext 
group elements does not exist in the literature. Moreover, were it not for the fact that this 
classification of massless states is a prediction of a currently fashionable research program, 
the claim might sound somewhat suspicious. For example, typically relations between physics 
and algebraic geometry rely crucially on supersymmetry. Yet, the proposed classification of 
massless states in terms of Ext groups is needed to hold for non-BPS brane configurations, 
as well as BPS configurations. 

In this paper, we shall begin to fill this gap in the literature. Using standard well-known 
methods, we explicitly compute, from first-principles, the spectrum of (BRST-invariant) 
vertex operators corresponding to massless Ramond sector states in open strings connect- 
ing D-branes wrapped on complex submanifolds of Calabi-Yau spaces at large radius, and 
explicitly relate those vertex operators to appropriate Ext group elements, for all possible 
configurations of complex submanifolds (both BPS and non-BPS). 

Although the methods involved are standard, we do find some interesting physical sub- 
tleties in the open string case. In the closed string case, such vertex operators are in one- 
to-one correspondence with bundle- valued differential forms, and so the spectrum of BRST- 
invariant vertex operators is expressed in terms of a cohomology theory of such bundle- valued 
differential forms, known as sheaf cohomology 1 . For example, in heterotic strings with holo- 
morphic gauge bundle £, some of the massless modes are counted by [11] 

H n {X, A m S). 

For another example, in the closed string B model [12], there is a one-to-one correspondence 
between (BRST-invariant) vertex operators and the sheaf cohomology groups 

H n {X, A m TX ) . 

In the case at hand, a naive analysis of the massless Ramond sector states in such open strings 
yields a counting in terms of sheaf cohomology groups, and not Ext groups. Although we 
show that the sheaf cohomology groups in question are always related mathematically to 
Ext groups via spectral sequences, these spectral sequences are often nontrivial - although 
sheaf cohomology can be used to determine Ext groups, a given Ext group element need not 
be in one-to-one correspondence with any sheaf cohomology group element. A more careful 
analysis reveals a physical subtlety that has the effect of realizing the spectral sequences 

1 Sheaf cohomology is defined for more general sheaves than merely bundles. Only in the special case that 
the sheaves in question are locally- free, i.e. that they correspond to bundles, does sheaf cohomology have 
a de-Rham-type description in terms of differential forms. We will only be interested in sheaf cohomology 
valued in bundles, not more general sheaves, and so for the purposes of making this paper more accessible to 
a physics audience, we will not distinguish between cohomology theories of bundle- valued differential forms 
and more general sheaf cohomology. 
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physically in terms of BRST cohomology, so the spectrum of massless Ramond sector states 
is, in fact, in one-to-one correspondence with Ext group elements. 

In the process of working out correspondences to Ext groups, we also run across some 
interesting interplays with other physics. For example, the Freed- Witten anomaly, together 
with another open string B model anomaly, plays a crucial role in understanding how Ext 
groups arise. 

Most of the paper is organized into a set of case-by-case studies of intersecting branes of 
increasing complexity. We begin in section 2 by reviewing the open string B model, and in 
particular, describe two anomalies that will play an important role in deriving Ext groups. 
One anomaly is the analogue for open strings of the statement that the closed string B model 
is only well-defined on Calabi-Yau's. The other anomaly is the Freed- Witten anomaly, which 
tells us that the gauge bundle on a D-brane worldvolume is twisted to a non- honest bundle, 
whenever the normal bundle to the worldvolume does not admit a Spin structure. 

In section 3, we discuss the relationship between open string boundary Ramond sector 
states and Ext groups in the simplest case, namely that in which the complex submanifolds 
on which the branes are wrapped are the same submanifold. The boundary states for this 
particular case already exist in the literature, although their relationship to Ext groups does 
not seem to have been previously discussed. The boundary states are naively counted by 
certain sheaf cohomology groups, which are related to Ext groups via a spectral sequence. 
We discuss the spectral sequence in detail, and include an example in which this spectral 
sequence is nontrivial, in the sense that the unsigned sum of the number of boundary vertex 
operators is not the same as the unsigned sum of the dimensions of the Ext groups. We 
describe the physical subtlety that alters the boundary state analysis, and show how, in fact, 
the spectral sequence is realized physically in BRST cohomology. Thus, we see explicitly 
that there is a one-to-one correspondence between massless Ramond sector states (properly 
counted) and Ext group elements. 

In section 4 we consider the relationship between boundary vertex operators and Ext 
groups in the next simplest case, namely when one submanifold is itself a submanifold of 
the other: T C S. We discuss the boundary vertex operators and the spectral sequence 
relating the vertex operators to Ext groups. We conjecture that the spectral sequence is 
realized physically as a modification of BRST cohomology, as happened in the case of parallel 
coincident branes. We also examine a naive problem with Serre duality that crops up when 
the line bundle A top NT/s is nontrivial, a puzzle that is resolved in the next section. We also 
note in this section that the degree of the Ext group as it arises in algebraic geometry can 
differ from the charge of the vertex operators (as used to determine the type of resulting 
massless fields). 

In section 5 we consider the general case of two intersecting complex submanifolds S and 
T, which need not be parallel. After disposing with the technical complications introduced 
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by having branes at angles, we find boundary vertex operators and spectral sequences that 
generalize the results of sections 3 and 4. However, in the general case there is an extremely 
interesting complication that did not appear previously. Previously there was always a spec- 
tral sequence relating the boundary vertex operators to Ext groups. However, in the general 
case, we find that in order for such a relationship to exist, we must take into account the 
Freed- Witten anomaly, which has been ignored in previous treatments of sheaf models and 
derived categories. This anomaly resolves apparent difficulties with Serre duality (including 
the difficulty first seen in section 4), as we discuss extensively. 

In section 6 we very briefly dispose of the case of nonintersecting branes. In section 7 we 
briefly begin to describe how one can see Ext groups of complexes, not just individual torsion 
sheaves, in a special simple case. (More extensive effort will be delayed to later publications.) 
Finally, in appendix A we give mathematical derivations of the spectral sequences that play 
an important role in the text. 

In passing, note that we are primarily concerned with only writing the spectrum of 
massless Ramond sector open string states in a more elegant fashion. Such analysis does 
not require the target brane worldvolume theory to be well-behaved; all we are doing is 
calculating part of the tree-level open string spectrum. For example, if the brane worldvolume 
theory contains a tachyon, then it is unstable; however, as we are merely rewriting the 
spectrum of string tree-level massless Ramond sector boundary states, such tachyons would 
not affect our calculations. Similarly, our calculations are insensitive to any anomalies in the 
target worldvolume theory. Again, we are merely rewriting part of the string tree-level open 
string spectrum; whether the target worldvolume theory has tachyons or anomalies certainly 
has a tremendous impact on the resulting physics, but does not alter the string tree-level 
open string spectrum. 

In the remainder of this paper, we shall make the following assumptions. First, all 
calculations are performed at large-radius (closely analogous to the original heterotic vertex 
operators calculated in [11]). Second, we only consider branes wrapped on (smooth) complex 
submanifolds of a Calabi-Yau, whose intersections are again smooth submanifolds. Thus, we 
are interested in counting massless Ramond sector states, or equivalently, B-twisted topologi- 
cal field theory states on the boundary of the open string. Third, we shall assume throughout 
this paper that the B field vanishes identically. Nonzero B fields play an interesting and 
important role in D-branes. If we turn on a B field, the mathematical analysis can be han- 
dled using derived categories of twisted sheaves. Since the complications introduced are not 
relevant to the main point of this paper, we content ourselves to set the B field to zero. 
Fourth, we shall only consider cases in which the gauge 'sheaf on the brane worldvolume is 
an honest bundle; we shall not attempt to study more general sheaves on the worldvolume 
of the brane. Finally, there are no antibranes in this paper, only branes. 
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2 Review of the open string B model 



2.1 Actions and boundary conditions 

Following the conventions of [12], the bulk B model action can be written in the form 

\gcfiW 3 + \g,-pW + Wil^- D ^- + Wij^+D^X + R m ^\^ 3 - (1) 

where 

i)\ g r (k <g> (j)*T lfi x) , 
e r (7T ® 0*t 1,o x) 

and with BRST transformations 

5(f) 1 = 0, 

5(f) 7 = ia (f + + it) , 
5ip l + = -ad(p l , 

&i> % _ = —ad(fi\ 

Following [12], we define 

rf = V>+ + it, 
&i = 9ij (V+ - V'- 

£ = 

and it is easy to calculate that in the absence of background gauge fields, the boundary 
conditions deduced from (1) are 

Srf = 59i = 0. 



Along Neumann directions, 



<9E 



so we see that 9i = for i an index along a Neumann direction, and similarly, along Dirichlet 
directions, 



i^lloE = -i>- 



las 
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so rf = for i an index along Dirichlet directions. 

In writing the boundary conditions above, we have neglected two important subtleties, 
one mathematical, and the other physical: 

1. First, although as C°° bundles TX\ S = TS © N s /x globally on S, as holomorphic 
bundles TX\ S ^ TS © N s /x in general. On any one (sufficiently small) complex- 
analytic local neighborhood U one can find complex-analytic coordinates such that 
TX\s\u — TS\u © N s / X \u, and such a choice of coordinates is implicit in writing 
the local-coordinate expressions for the boundary conditions given above. However, 
because TX\$ does not split globally on S, it is not quite correct to say that 9i — 
for directions "normal" to S implies that the 0's couple to N s /x, as one would naively 
believe. We shall speak more about this bit of mathematics in section 3.3, when it 
becomes physically relevant. 

2. A second subtlety arises from physics, and is due to the fact that along Neumann 
directions, the Chan-Paton factors twist the boundary conditions (see e.g. [13]), so that 
in fact 9i = (Tr F^) rf. We will (eventually) see that taking into account that Chan- 
Paton-induced twist has the effect of physically realizing spectral sequences discussed 
below in terms of BRST cohomology, so that the massless Ramond sector states are in 
one-to-one correspondence with Ext group elements. 

2.2 Two anomalies 

Before proceeding to calculations of massless boundary Ramond spectra, we should review 
two types of anomalies in the open string B model. 

2.2.1 Open string analogue of the Calabi-Yau condition 

The first anomaly we shall discuss is a close relative of a certain closed string B model 
anomaly. Recall the closed string B model is only well-defined for Calabi-Yau target spaces 
[12], unlike the A model. The reason for this is well-definedness of the integral over fermion 
zero modes. For example, when the worldsheet is a P 1 and the target is a three- fold, there 
are three and three vp l _ zero modes, and to make sense of the integration 



implicitly assumes the existence of a trivialization e-j. But, such a trivialization is a nowhere- 
zero (anti) holomorphic top-form, which exists if and only if the target is a Calabi-Yau. 
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There is an analogous issue in the open string B model, though the form of the anomaly 
varies depending upon the D-branes. Assume that the worldsheet is an infinite strip, with 
one side on submanifold S and the other on submanifold T, the gauge bundle on the D-brane 
on each side of the strip is trivial (simplifying the boundary conditions), and TX\$ splits 
holomorphically as TS © N$/x for each D-brane. We will also assume that the intersection 
S H T is a manifold. Then, there are fermion zero modes coupling to T(S H T) and to 



TX 


SnT 


TS\snT + TT\ 


SnT 



(see the section on general intersections for more details). Thus, because of these zero modes, 
the partition function is a section of 

A top T*{SnT) © A top N y 

which (as we shall demonstrate in more detail later in section 5.4) is isomorphic to 

A top N S nT/s ® A top N S nT/T 
Thus, in order for theory on the strip to be well-defined, the line bundle 

A top N SnT/s ®A top N SnT/T 

must also be trivializable, so that the fermion zero mode integral is well-defined. 

We conjecture that the case of more general boundary conditions can be understood as 
arising from the determinant of the complex 

- T(S n T) - T(S)\snT © T(T)\ SnT - T(X)| 5nT - 

which exists even if the normal bundle does not split. 

We shall discuss this anomaly further in section 5.5, where we shall check that it does 
not exclude any known supersymmetric brane configurations, and also discuss how it gives 
a new selection rule. 



2.2.2 The Freed- Witten anomaly 

The second class of anomalies that is relevant to this paper is due to Freed- Witten [14]. In 
their analysis 2 of open string theories, they found two interesting physical effects: 

1. First, they found that a D-brane can only consistently wrap submanifolds S with the 
property that the normal bundle N s /x admits a Spin c structure. 

2 Although their paper was originally written for physical untwisted open string theories, the results also 
apply to the open string B model [15]. 
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2. Second, if the normal bundle N s /x admits a Spin c structure, but not a Spin structure, 
then the gauge bundle on the D-brane worldvolume must be twisted. 



All complex vector bundles admit Spin c structures, so the first effect is irrelevant for our 
purposes. The second effect is much more relevant, as not all complex vector bundles 3 admit 
Spin structures. It means that the gauge bundle on the D-brane worldvolume is not always 
an honest bundle. In particular, on the D-brane corresponding to the sheaf i*£, the gauge 
bundle can not be merely £. 

This second effect might seem rather confusing, in light of the fact that we usually 
identify sheaves with D-branes in a very direct way. What this effect tells us is that the 
precise relationship between sheaves and D-branes is slightly more subtle than we usually 
believe. We need to work out the correct identification between physical branes and sheaves. 

Before we state the result, we want to emphasize an important point: this identification 
cannot be unique. The reason is that the derived category of sheaves has autoequivalences. 
In particular, if L is any line bundle on X, then tensoring with L gives an autoequivalence 
of the derived category. So any identification between branes and sheaves can only be well 
defined up to an overall tensoring with L, or more precisely, its restiction to S. 

Now, what is a correct way to take into account this twisting? We will show that this can 
be done by replacing the D-brane worldvolume bundle £, above, with the 'bundle' 8®^K^, 
which is often not an honest bundle, but rather a twisted bundle, in the sense of [14]. This 
twisting is referred to as the canonical Spin c lift in the literature. In particular, for S a 
submanifold of a Calabi-Yau, \J Kg is an honest bundle if and only if the normal bundle 
N s /x admits a Spin structure, not just a Spin c structure, so we see that this ansatz does 
correctly twist the worldvolume gauge bundle as prescribed in [14]. By the remarks above, it 
would have worked just as well to identify sheaves with branes via associating to any bundle 
£ on any S the 'bundle' £ <g> Jk^ <g> L\ s . 




In Section 5.3 we will show that this identification between branes and sheaves identifies 
open string spectra with Ext groups of sheaves in general. It appears to be the unique way 
to do so up to the ambiguities discussed above. 

Let us say a few words about this last point. For fixed S, the most general way to 
identify bundles on S with branes is by fixing a bundle Ls and associating to the bundle 
£ the 'bundle' £ <g> yj 'Kg ® Lg. Our computations in Section 5.3 imply that if we look at 
open string spectra with boundary conditions on different submanifolds S and T, then the 
spectra coincide with Ext groups if and only if 



3 For example, the tangent bundle to the projective plane P 2 does not admit a Spin structure. More 
generally, any complex vector bundle with c\ odd does not admit a Spin structure. 




Ls\snT — L T \ SnT . 



(2) 
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Now let L = Lx- Then (2) with T = X says that Ls = L\s, and we are reduced to precisely 
the ambiguity noted above. So our identification of branes with sheaves is as unique as it 
can be. 

Despite the ambiguity it is both natural and convenient to fix it by using the canonical 
Spin c lift, i.e. associating £ ® y 1 Kg to £, and we will do so in the remainder of this paper. 

This choice is also the right one for describing D-brane charge in terms of sheaves. The 
ABS construction gives a commutative diagram 

K(S) >K(X) 



K tw (S) 



where the map from K(S) to K(X) is defined using the canonical Spin c lift of Ns/x and 
the canonical Spin c structure on S is used to identify twisted sheaves with twisted K-theory 
classes. One consequence of commutativity is that x(E) equals the index of the Dirac 
operator of E <g) \J K^, which we will justify momentarily. The index of the Dirac operator 
is an invariant of the total D brane charge. Thus our identification equates %(£') with said 
invariant of the D brane charge. This makes quantitative the conservation law observed in 
[14]. 

To justify the identification, we use the splitting principle and formally write C\{S) = 
Et^ S U and c(E) = n^i kE (l + ej). Then by Riemann-Roch 




X (E) = J s ch(E)ATd(S) 

= Is (Ej exp(ej)) Hi T- 



while the invariant of the D brane charge for our conventionally associated brane 8 
is by the Atiyah-Singer index theorem 

N = J s ch(£®jKf)A(S) 

= J s (E J exp(e j + (E i ti)/2))n ii ^. 

The equality N = x(E) * s readily checked using the identity 

J/2 V 2 



= e 



* sinht/2' 



In any event, we can now see how to take into account the Freed- Witten twisting. From 
the discussion above, for a D-brane wrapped on a sub manifold % : S X, the worldvolume 
gauge bundle that corresponds to the sheaf i*£ is given by £ ® yKg, and not £. This 
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gauge bundle is an honest bundle whenever the normal bundle admits a Spin lift, and is not 
an honest bundle, otherwise. We shall see later in section 5.3 how this particular twisting 
is uniquely determined up to an overall line bundle by consistency with other aspects of 
physics. 

For many parts of this paper, we shall be able to simply ignore this twisting by \J K^. For 
example, when computing spectra between D-branes on the same submanifold, each Chan- 
Paton factor will come with a \J K^, and these factors will cancel one another out. When 
considering D-branes wrapped on distinct submanifolds, on the other hand, these factors 
will become extremely important, and in fact we shall see that their presence is absolutely 
required in order for Serre duality to close the spectra back into themselves, and in fact to 
recover Ext groups at all. Thus, for most of this paper we shall ignore the \J Kg twisting, 
and will only return to this issue in the section on general intersections, where it will play a 
crucial role. 



3 Parallel coincident branes on 5^1 

In this section we shall compute the massless Ramond sector spectrum of open strings 
between two D-branes on the same complex submanifold S of a Calabi-Yau manifold X, 
with inclusion % : S X. We shall assume one of the branes has gauge fields described by 
a holomorphic bundle £, and the other has gauge fields described by a holomorphic bundle 
T . Our methods are standard and well-known in the literature; see for example [11] for a 
closely related computation of massless states in heterotic string compactifications and [12] 
for another closely related computation of vertex operators in the closed string B model. 



3.1 Basic analysis of massless boundary Ramond spectra 

Now, let us explicitly construct massless Ramond sector states, assuming for the moment 
that TX\s splits holomorphically as TS © N$/x, and that the Chan-Paton factors have no 
curvature, so that the boundary conditions on the worldsheet fermions are easy to discuss. 
These are states that, in an infinite strip, would be placed in the infinite past, or alternatively, 
if one conformally maps to an upper half plane with different boundary conditions for x > 
and x < 0, these are vertex operators that would be placed on the boundary at x — 0. 
The calculational method we shall use is a simple extrapolation of Born-Oppenheimer-based 
methods discussed in, for example, [11, 12]. Since we are working in a Ramond sector, the 
worldsheet bosons and fermions contribute equally and oppositely to the normal ordering 
constant, so massless states are constructed by acting on the vacuum with zero modes. Also, 
since we are dealing with zero modes of strings, the Chan-Paton factors appear as nothing 
more than indices on the vertex operators, as in [18]. 
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For D-branes wrapped on the same complex sub manifold S <^-> X, as discussed above, 
we have boundary vertex operators 

(where a, (5 are Chan-Paton indices). Because of the boundary conditions, the 6 indices are 
constrained to only live along directions normal to S, and the rj indices are constrained to 
only live along directions tangent to S. Also, because of boundary conditions the <p zero 
modes 0o are constrained to only map out S. Also note that we are implicitly using 6 and r] 
to denote zero modes of both fields. These vertex operators are in one-to-one correspondence 
with bundle-valued differential forms living on S, and their BRST cohomology classes are 
identified with the (sheaf cohomology) group 

H n [s, £ v <g> T ® k m N s /x) (3) 
where N$/x is the normal bundle to S in X. 

Note in passing that this calculation is very similar to several other closed string calcu- 
lations, where analogous results are obtained. For example, closely related computations in 
heterotic string compactifications with holomorphic gauge bundle S show there are massless 
states counted by [11, section 3] 

H n (X, A m £), 

and in the closed string B model [12], vertex operators are counted by the sheaf cohomology 
groups 

H n ( X, A m TX ) . 

Readers not familiar with the techniques being used may find sheaf cohomology unfamiliar, 
but in fact sheaf cohomology is nearly ubiquitous in these sorts of vertex operator computa- 
tions. 

The boundary states we have described above are not new to this paper; the same vertex 
operators are also described in, for example, [16, section 6.4] or more recently [17]. However, 
neither vertex operators for more general brane configurations (in which both sides of the 
open strings are not on the same submanifold) nor the relationship of these vertex operators 
to Ext groups have been discussed previously in the literature, and these topics will occupy 
the bulk of our attention in this paper. 

We should also take a moment to speak to potential boundary corrections to the BRST 
operator. In the vertex operator analysis above, we implicitly assumed that the BRST 
operator on the boundary is the same as the restriction of the bulk BRST operator to the 
boundary. We claim that, modulo covariantizations, this is a reasonable assumption. Two 
general remarks should be made to clarify this matter further. 

• First, from the Chan-Paton terms [18] 

J (fA - irfF- lj( j) 
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we find that the Noether charge associated with the BRST operator picks up a term 
proportional to Afr]\ where A is the Chan-Paton gauge field. This term merely serves 
to covariantize the BRST operator. After all, the BRST operator essentially acts as 
d, but for fields coupling to bundles, one must add a connection term. Thus, adding 
contributions from the Chan-Paton action to the Noether current for the boundary 
BRST operator merely serves to covariantize the BRST operator. 

• Second, in [4, section 2.4], certain additional boundary-specific terms added to the 
BRST operator played an important role. These terms arose after deforming the 
action, modelling giving a nonzero vacuum expectation value to a tachyon in a brane- 
antibrane system. Here, at no point will we consider deformations of the action. Thus, 
no boundary-specific contributions to the BRST operator of the form used in [4] will 
appear here. 

Thus, in our analysis, the boundary BRST operator will always be the restriction of the 
bulk operator to the boundary (modified by covariantization with respect to the Chan-Paton 
gauge fields). 

Serre duality acts to swap open string states of the form (3) with those of open strings 
of the opposite orientation. To see this, a useful identity is, for any complex bundle Q, 

A ng ^ ( A r - n V ) <g> (A r G) (4) 

where r = rank Q, so as A top N s /x — K s , we see that Serre duality implies 

H n (s, £ v <g> T ® A m N s/x ) = H s ' n (s, T y <g> £ ® A r - m N s/x ) * 

where s = dim S and r = dim N$/x- Also note that the boundary operator of maximal 
charge that corresponds to the holomorphic top form uj il ... in dz 11 A ■ • • A dz ln of the Calabi- 
Yau always exists in this case (assuming £ = T and suppressing Chan-Paton indices) and is 
given simply by 

— js+l-jn H , , .tfsQ. ...n. 
^ll-ls '/ '/ U ]s+1 U 3n 

where s = dim S and in this one equation n = dim X. Later, when considering more general 
boundary conditions, we shall find cases in which Serre duality is no longer an involution of 
the boundary vertex operator spectrum, and in such maximal-charge vertex operator 

corresponding to the holomorphic top form of the Calabi-Yau will no longer exist. 

In the literature, it is frequently asserted that open string modes are in one-to-one cor- 
respondence with global Ext groups between torsion sheaves representing the D-branes. In 
the present case, this would be the claim that the open string modes are in one-to-one 
correspondence with elements of 

Ext^ {i*£, i*T) 
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where i*£ and %*T are sheaves supported on S <^-> X, identically zero away from S, that look 
like the bundles £ and T over S. 

By contrast to the assertions quoted above, our naive description of the open string 
boundary vertex operators is in terms of bundle-valued differential forms which lead to (3) 
rather than Ext groups. However, that is not to say they are unrelated to Ext groups; they 
do determine Ext groups mathematically via the spectral sequence 

: H p (s, £ w ®F® A q N s /x) Ext^ +9 (5) 

(See appendix A for a derivation.) 

Earlier we mentioned that our boundary conditions were slightly oversimplified, in that 
along Neumann directions, the 9i do not vanish, but rather obey 0* = (Tr F^) rf [13], some- 
thing we have so far neglected. In the special case that the simpler boundary conditions are 
correct, the spectral sequence above trivializes, and so the sheaf cohomology groups are the 
same as Ext groups: 

Ext£ (u£, uT) = H p (s, f <g> T <g> A q N s/x ) 

p+q=n 

When the boundary conditions are more complicated, we will find that the spectral sequence 
above is realized physically via BRST cohomology. In any event, we shall see that in all cases, 
the massless Ramond sector states are actually in one-to-one correspondence with Ext group 
elements. 

For the moment, we shall check our vertex operator analysis in some simple examples in 
which the spectral sequence is trivial. After that, we shall work through the subtleties in 
the boundary conditions mentioned above. 

3.2 Examples 

We shall check our vertex operator counting in the following two extreme cases: 

1. Branes wrapping a Calabi-Yau 

2. Points on Calabi-Yau manifolds 

First, consider branes wrapping an entire Calabi-Yau, i.e., S — X. In this case, N s / X = 0, 
so the spectral sequence degenerates to give 

Ext n x (£,F) = H n (X,£ y ®F) 
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and the massless Ramond sector boundary states are of the form 



These boundary states are well-known (see for example [16]), and their low-energy inter- 
pretation is a function of their U(l) charge. For example, from the charge zero operator 
b (4>o) one can construct a conformal dimension one operator exp(— 0)6 a/3 -^ M , where <f) is the 
bosonized super conformal ghost and ijj^ a worldsheet fermion transforming as a spacetime 
vector. Such charge zero operators correspond in this fashion to low-energy gauge fields. A 
charge one operator, say bj^rf ', corresponds to a low-energy spacetime scalar, with vertex 
operator of the form exp(— 0)6" /3 r/*, which is a conformal weight one operator transforming 
as a spacetime scalar. As this story is well-known, we shall not belabor the point further. 

Next, we shall consider branes 'wrapped' on points on Calabi-Yau threefolds. Consider 
for example N D3-branes at a point S on a Calabi-Yau threefold X. For notational brevity, 
define S = (9 e7V . The nonzero sheaf cohomology groups are 



The first and last sheaf cohomology groups are Serre dual, and correspond to open strings 
of opposite orientation; the second and third groups are also Serre dual. Thus, we need 
only consider the first two groups. The first group describes states of U(l) charge zero, and 
so correspond in the low-energy theory to components of a U(N) gauge field. The second 
describes states of U(l) charge one, and so correspond in the low-energy theory to three 
adjoint- valued fields. Thus, we recover the expected field content for D3-branes at a point 
on a Calabi-Yau threefold. 

In these examples there was a natural correspondence between the degree of the Ext 
group and the U(l) charge, as correlated with the type of low-energy field (vector, scalar, 
etc). However, in later sections we shall see explicitly that unfortunately this correspondence 
cannot hold in general. 

3.3 First subtlety: mathematics 

We mentioned earlier that there were two subtleties in the boundary states. The first subtlety 
described is, on its face, an obscure mathematical point. Namely, although for C°° bundles, 



H°(S,£ V ®£) = C 



H° (s, £ v ®£® A 2 N S/X ) = C 3 
H° (s, E y ®E® A 3 N s/ x) = c 




determining 
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TX\s — TS © Ns/x, this is not true for holomorphic bundles in general. As a result, the 
interpretation of boundary conditions such as 9i = is somewhat subtle. 

We will see that this subtlety, on its own, has little real effect. Its proper understanding 
does not alter the naive conclusion above, that massless Ramond sector states appear to be 
counted by sheaf cohomology groups, and not Ext groups. In order to see explicitly that the 
massless Ramond sectors states are actually counted by Ext groups, we shall have to use 
the second subtlety mentioned. However, although this subtlety will not have a significant 
impact on the results, its proper understanding will play a significant role in the physical 
realization of the spectral sequence discussed earlier, and for that reason we shall discuss it 
in detail. 

In general, globally on S, TX\ S is merely an extension of N s /x by TS: 

— > TS — ► TX\ S — ► N s/X — ► 0. 

One simple example in which TX\$ does not split involves conies C in P 2 . There, TC = 
0(2), TP 2 | C = 0(3) © 0(3), and N c/P 2 = 0(4), so clearly TP 2 | C ^ N c/P 2 © TC; rather, 
TV 2 \ C is merely an extension of 0(4) by 0(2). Although globally one cannot split TX\ S 
holomorphically, in any one sufficiently small complex-analytic local coordinate patch, one 
can arrange for TX\s to split, and boundary conditions such as 9i = are implicitly written 
in such special coordinates. 

What effect does this subtlety have? First, note that if we are working in a special case 
in which TX\s does split, i.e., in special cases in which TX\s = Ns/x ®TS holomorphically 
globally on S, then the analysis of the previous section goes through without a hitch. If 
TX\ S splits globally on S, then the local-coordinate expression 9 { = does indeed imply 
that the 0's couple to Ns/x, and the previous analysis is unchanged. 

If TX\ S ^ TS © Ns/x, then the analysis is more complicated, but the result is the same. 
For simplicity let us consider vertex operators with a single 9, naively corresponding to sheaf 
cohomology valued in Ns/x- Since TX\ S ^ TS © N s /x, it is no longer true that 0j = 
implies that the 9 couple to Ns/x- After all, under a change of coordinates, Ns/x will mix 
with TS, and so the condition 9i — for Neumann directions is will not be invariant under 
holomorphic coordinate changes. Rather, the 9 merely couple to TX\s, but are constrained 
such that in certain special complex-analytic local coordinates, some of the 9 vanish. In 
particular, sheaf cohomology valued in N s /x can no longer be translated directly into vertex 
operators. 

We can deal with this more complicated scenario as follows. Although sheaf cohomology 
valued in N s /x can not be used to write down vertex operators immediately, we can lift 
differential forms valued in Ns/x to differential forms valued in TX\$, and we can write 
down vertex operators associated to those TX\ s- valued differential forms, since the 9 t couple 
toTX\ s . 
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Now, something interesting happens when we demand BRST invariance of those newly- 
minted TX | s- valued forms; namely, they need no longer be enclosed 4 , yet they still define 
BRST-invariant states. 

Mathematically, we are taking advantage of a commuting diagram which we shall write 
schematically as 

A°' n (TS) ^A°> n (TX\ s ) ^A°> n (N s/x ) 



d 



8 



a 



A°> n+1 (TS) ^°-" +1 (TX|s) A°> n+1 (N s/ x) 

where A°' n denotes differential (0, n) forms, horizontal arrows are induced by the short exact 
sequence above, the rows are exact, and we have suppressed the factors £ y ® T throughout. 
The image under d is a higher-degree TX\ s - valued form, and from commutativity of the 
diagram above, that higher-degree form is the image of a TS-valued form. 

Technically what we are doing is realizing the coboundary map in the long exact sequence 
of sheaf cohomology 

H n (s, E y <g> T <8> N s/X ) — > H n+1 (S, E y ® T ® TS) 

induced by the short exact sequence 

— > TS — ► TX\ S — ► N s/X — ► 0. 

In algebraic topology, such a map is known as the Bockstein homomorphism. We started 
with a TVs/x-valued form, and created a TS-valued form of higher degree. The physical 
vertex operators are defined by the TX\ s- valued differential forms appearing in the first 
intermediate step. 

Now, how can this be BRST invariant, as claimed? We started with iVs/x -valued sheaf 
cohomology, lifted the coefficients to TX\s to create differential forms that we could associate 
to vertex operators, and then argued that d of those differential forms gives enclosed TS- 
valued differential forms of one higher degree. But in order to be BRST invariant, our vertex 
operators (associated to TX\ S - valued forms) must be annihilated by d. 

The answer is in the boundary conditions = (for Neumann directions). These bound- 
ary conditions annihilate TS-valued forms. Thus, since the image of our vertex operators 
under d is TS-valued, our vertex operators are closed under the BRST transformation. 

Now, the reader might well ask, why we went to the trouble of working through these 
details. What we have concluded, after considerable effort, is that even though TX\$ ^ 

4 In the special case that the TX\s splits globally on S, i.e. TX\s — Ng/x ® TS, then it is possible to 
generate a closed TX\s- valued differential form from any closed iVg/x-valued differential form. When TX\$ 
does not so split, this is not always possible. 
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TS®N s /x holomorphically on S, the massless Ramond sector states are nevertheless counted 
by the sheaf cohomology groups 

H n (s, E y ® T ® A m N s/x ) 

(at least so long as we are dealing with the boundary condition described as 0* = for 
Neumann directions). The vertex operators are slightly more complicated to express than 
one would have naively thought, but at the end of the day, we do not seem to have learned 
anything significantly new. 

The reason we went to this trouble is that this complication will play an important role 
when unraveling the next subtlety, involving the altered boundary condition Qi = (Tr F^) rf. 
The coboundary map discussed in detail above will form half of the differential of the spectral 
sequence. As here, vertex operators will be associated to TX\$- valued differential forms 
created by lifting iVs/x-valued enclosed differential forms, and the BRST operator will act 
as d on those TX\ S - valued forms. Just as here, the result will be a TS- valued form, at 
which point we can apply the boundary condition on the 0's. Unlike the present case, the 
boundary condition will not annihilate any TSWalued 0's, so demanding BRST-invariance 
of our TX 1 5- valued forms will give an additional condition that will be equivalent to being 
in the kernel of the differential of the spectral sequence. 

3.4 Second subtlety: physics 

The second subtlety we mentioned previously was that along Neumann directions, in suitable 
local complex-analytic coordinates, it is not true that 0j = 0, but rather 6>j = (Tr F^) rf. 
We shall deal with this subtlety in this section. We shall find that this subtlety effectively 
alters the BRST cohomology in such a way that the spectral sequence discussed earlier is 
realized directly in BRST cohomology. Thus, the spectrum of massless Ramond sector states 
is counted directly by Ext groups, instead of sheaf cohomology. 

We begin this section by discussing the nontriviality of the spectral sequence, followed 
by a detailed discussion of the differentials of the spectral sequence. Finally, we describe 
explicitly how those differentials are realized physically. 

3.4.1 Nontriviality of the spectral sequence 

We have argued that, after making a slight simplification of the boundary conditions, mass- 
less Ramond sector states in open strings are in one-to-one correspondence with sheaf coho- 
mology groups, related to Ext groups via a spectral sequence. We shall argue shortly that 
this spectral sequence is realized physically after taking into account the correct boundary 



20 



conditions, but before we work through those details, we shall discuss the spectral sequence 
in greater detail. 

In particular, in this subsection we shall discuss the nontriviality of the spectral sequence, 
because if the spectral sequence were always trivial, then there would be little point in 
worrying about it. In general, spectral sequences lose information - the fact that the obvious 
bigrading structure of the sheaf cohomology groups reduces to a unigraded structure is one 
indication of this loss of information. However, in the explicit examples we have computed 
above, it was the case that the spectral sequence was trivial, in the sense that the dimension 
of an Ext group was the same as the sum of the dimensions of the sheaf cohomology groups 
feeding into it. 

If it were always the case that the spectral sequence were trivial, i.e., if it were always 
the case that the number of independent sheaf cohomology group elements was the same 
as the number of independent Ext group elements, then our point that formally spectral 
sequences lose information would seem rather moot, and discussions of physical realizations 
of the spectral sequence would be rather pointless. 

However, in general, the spectral sequence relating the sheaf cohomology groups to Ext 
groups is not trivial - the number of independent boundary vertex operators is not the same 
as the number of Ext group generators. Thus, the map from boundary vertex operators to 
Ext group elements is not invertible, in the strongest sense of the term. On the other hand, 
the signed sum of dimensions of sheaf cohomology groups will always be the same as the 
signed sum of the dimensions of the Ext groups. This will be the case in general, as d p r ,q 
maps E2' 9 to £]P +r,q ~ r+1 and so will always increase the charge of an operator by 1. Thus 
the spectral sequence will always cancel out vertex operators in pairs, with differing sign in 
the index. 

One example in which this spectral sequence is nontrivial is as follows. Let X be a 
K3-fibered Calabi-Yau threefold, and let S be a smooth K3 fiber. Assume further that S 
contains aC^P 1 which is rigid in X, having normal bundle Nq/x — Oc{~ 1) © @c{— !)• 
This typically implies that the bundle OsiC) itself does not deform to first order as S moves 
in the fibration, but let's add that as another explicit assumption. 

Let £ = T = OsiC). We claim that this gives an example with a non-trivial spectral 
sequence. 

First note that the sheaf i*Os(C) does not deform, not even to first order. To see this, 
first observe that the support S of i*Os(C) can only deform in the given fibration; but then 
we have assumed that i*Os{C) does not deform in the fibration so the sheaf i*Os(C) does 
not deform in X in any way whatsoever. 

Next we note that Ext 1 (i*O s (C), i*O s (C)) is the space of first order deformations of the 
sheaf i*C?s(C), which we have just shown is 0. 
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But the spectral sequence (5) has the nontrivial terms 

£ 2 0,1 = H°(S, £ w ®T® N s/X ) = H°(S, O) = C 

and 

E 2 / = H 2 (S, £ v <g> T) = H 2 (S, O) = C. 

It is immediate to additionally check that E 2 '° = E 2 ' 1 = C and all other terms in the 
spectral sequence are 0. 

The spectral sequence (5) has a differential d®' 1 : E? 1 — > -E 1 ^' which we will argue is 
nontrivial. Since E 2 ,q = for p > 3, all the differentials d™ vanish for r > 3. So g^!' 1 is 
the only differential in the spectral sequence that could be nonzero. If it were zero, then 
we would compute Ext^^C^C), i*Os{C)) ^ 0, a contradiction. So d 2 ,x is nonzero. In 
particular we have an open string mode corresponding to an element of H°(S, Ns/x) which 
does not parametrize a nonzero Ext element. 

As an explicit example, consider X = P(l, 1, 2, 2, 2) [8] considered in [19]. The K3 fi- 
bration comes from the map X — > P 1 sending (x±, . . . ,x 5 ) to (xi,x 2 ), and the general K3 
fiber is identified with a degree 4 K3 hypersurface in P 3 . While a general degree 4 surface 
contains no lines, it was argued that if X has general moduli, then exactly 640 of these de- 
gree 4 K3 surfaces contain a line, and that these are rigid in X. Furthermore, still choosing 
X to have general moduli, we can assume that the general K3 fiber has Picard number at 
least 1. Recall [20, Pp. 590-94] that the moduli space M 2 of quartic K3 surfaces with Picard 
number at least 2 is a generically smooth divisor in the moduli space M 1 of quartic K3's with 
Picard number 1. Given X, we get a map ipx '■ P 1 ~^ Mi sending a point to the K3 fiber it 
parameterizes. It is easy to check that if X is general, then ipx meets M 2 transversally at 
smooth points. This is enough to guarantee that OsiC) does not deform to first order as S 
moves in the K3 fibration. 

3.4.2 Details of the differentials 

We have just argued that the spectral sequence relating sheaf cohomology to Ext groups is 
nontrivial in general, so it is very important to check that that spectral sequence really is 
realized physically. Before we describe the physical realization of the spectral sequence, we 
will first describe the differentials in more detail. 

Consider the special case of an open string connecting a D-brane to itself. In this case, 
we have the same Chan-Paton gauge field on either side of the open string. In this case, the 
level two differential 

d 2 : H° [S, £ y ®£® N s/X ) ^ H 2 (S, £ v ® £) 
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is realized mathematically by the composition 

H° (s, £ v ®£® N s/ x) — ► H 1 (S, £ V ®£®TS) — > H 2 (S, £ v ® £) . 

The first map in the composition is the coboundary map 

H° (s, £ v <g> £ <g> AT 5/X ) — ► iJ 1 (5, £ v <g> £ <g> TS) (6) 

in the long exact sequence of sheaf cohomology induced by the tensor product of the short 
exact sequence 

— TS — TX| 5 — iV 5/x — (7) 

with £ v ® £. We discussed this coboundary map in detail in section 3.3. Recall from 
section 3.3 this coboundary map vanishes if TX\s = TS © Ns/x globally on S; it is only 
nontrivial if TX\$ does not split globally. Put another way, if TX\s splits globally, then the 
spectral sequence is trivial. 

The second map in the composition is much easier to describe. It involves contracting 
the TS indices on the trace of the curvature form of the connection on the bundle. In other 
words, if 9i schematically indicates a TS direction, then the second map in d 2 involves the 
replacement 

0. _> ( Tr Fq) dzl (8) 

The close relationship between the expression above and the altered boundary conditions 
induced as in [13] is no accident, and forms the heart of the physical realization of the spectral 
sequence. 

In principle, the higher differentials are constructed from the same ingredients. For 
example, let us consider 

d 3 : E / — £ 3 3 '°- 

Note that E Q / consists of the part of E°f = H°(S, £ y ® £ ® A 2 N S/X ) that is annihilated by 
d 2 . Consider the short exact sequence 

-> N s/X ®TX^ N s/X ® TX\ S -> N s/X ® N s/X -> (9) 

obtained from (7) by tensoring with Ns/x- In this case, d 2 acts by combining the coboundary 
map of (9) with the replacement (8). In other words, to see the action of d 2 , lift the A 2 N S / X - 
valued zero form to a Ns/x <S> TX|s-valued form, then apply d and commutativity of (3.3) 
to get a Ns/x <8> TS'-valued (0, l)-form. Finally apply (8) to get a iVs/x-valued two-form. 
Here we have viewed A 2 Ns/x as the subbundle of antisymmetric elements of Ns/x <8> Ns/x- 
The part of H°(S, £ v <E> £ <E> A 2 A^^/x) i n the kernel of this map is E^ 2 . The differential d 3 
acts on E®' 2 by lifting the A 2 iVs/x-valued form to a A 2 TX| s - valued form, applying d, and 
contracting both of the resulting TS indices with the curvature, using (8). The resulting 
indices correspond to TS rather than merely TX\s by the assumption that our A 2 N s /x~ 
valued section is in the kernel of d 3 . 
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3.4.3 Physical realization of the spectral sequence 



So far in our analysis of massless Ramond sector states, we have assumed that along Neumann 
directions, Qi = 0. However, strictly speaking this is only the case when one has trivial 
Chan-Paton gauge fields. As noted many years ago in e.g. [13], in the presence of nontrivial 
Chan-Paton gauge fields, Neumann boundary conditions are twisted by the curvature of 
the gauge field. For example, for worldsheet scalars, ordinarily the Neumann boundary 
conditions state that 



where n denotes the direction normal to the boundary. If the Chan-Paton factors have 
nontrivial curvature, this condition is modified to become 



Although this twisting of boundary conditions seems to have been largely ignored in most 
discussions of the open string B model, it has played an important role elsewhere in physics 
recently (see e.g. [21]). 

Let us carefully consider how this modifies our analysis of massless Ramond sector states. 
Boundary conditions for worldsheet fields coupling to directions normal to the brane are 
unchanged, as otherwise it would be impossible to make sense of the Chan-Paton action. 
Boundary conditions for worldsheet fields coupling to directions parallel to the brane, how- 
ever, are changed as above. One still has constant bosonic maps, as the modified boundary 
conditions above only couple to derivatives of the worldsheet bosons. The boundary condi- 
tions on the worldsheet fermions can now be written in suitable local coordinates as 



In general, if the Chan-Paton factors on either side of the open string are different, then 
these boundary conditions will change the fermion moding, and hence change the fermion 
zero-mode structure. Put another way, the effect of these boundary conditions is very closely 
analogous to the effect of having branes at angles, as discussed in [22]. 

We shall only consider the special case that the Chan-Paton gauge fields on either side 
of the open string are identical, i.e., that the open string is connecting a D-brane to itself. 
This corresponds to the 'dipole string' case discussed in [13]. In this special case, one has 
the same fermion zero modes as assumed previously, so the analysis is very similar to that 
discussed so far, except that the Qi no longer couple to N$/x- Instead, because the Qi parallel 
to the brane can be nonzero, the Qi merely couple to TX\s- 

As before, boundary vertex operators should be of the general form 



d n x = o 



d n X* 



(Tr Ft) d t X\ 



Qi = (Tr Fq) rf. 



(10) 
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(where a, (3 are Chan-Paton indices). Now, however, there are subtleties in the interpreta- 
tion. The 9i couple to TX\ S , not N s /x, and in principle 9i parallel to the brane are related 
to the rf> by the boundary conditions. In the special case that TX\ S = N s /x ® TS holomor- 
phically, we can simply ignore the 9i parallel to the brane, use only 9i normal to the brane 
to construct the vertex operators above, and immediately recover a classification in terms of 
sheaf cohomology. In this same case, the spectral sequence relating sheaf cohomology to Ext 
groups is trivial. When the spectral sequence is nontrivial, TX\ S ^ N S /x ® TS, but rather 
is merely an extension of N s /x by TS. In this case, although locally in coordinate patches 
one can distinguish 9{ parallel to the brane from 9i normal to the brane, globally along S 
one cannot make such a distinction. 

Let us assume that TX\s ^ Ns/x ® TS, and work out how to describe the vertex 
operators. For simplicity, for the moment we shall only consider vertex operators of the form 

b^^ )9 r (11) 

We shall argue that computing BRST cohomology is equivalent to evaluating the spectral 
sequence. 

First, because the 9; L couple to TX\ S and not N s /x, we cannot associate elements of 
H°(£ v <g> £ <S> N S / X ) with the vertex operator (11). Also, because the 9i "parallel" to the 
brane (not a well-defined notion when TX\$ does not split holomorphically) are related to 
the rf by the curvature of the Chan-Paton factors, we cannot merely claim that the BRST 
cohomology is simply H°(£ v <S> £ <E> TX\s)- Instead, let us proceed more carefully. We can 
manufacture an operator that is 'close' to being BRST-closed by starting with an element 
of H°(£ v <S> £ <S> N s /x), and lifting the coefficients to TX\ S to recover a (not-necessarily- 
closed) differential form valued in TX\g. We can associate such a differential form with a 
vertex operator of the form (11). Unfortunately, the resulting vertex operator need not be 
BRST-closed, as the corresponding differential form is not (^-invariant, and because of the 
boundary conditions on some of the 

Let us now work out the action of the BRST operator on this vertex operator. So, act on 
the vertex operator with the BRST operator, or equivalently, act on the zero form with d, 
to generate a closed one- form. We now have a closed one-form valued in TX\s- Even better 
- exactly as in the discussion of the coboundary map in section 3.3, our closed TX\g- valued 
one-form is mathematically the image of a closed TS-valued one-form. 

In other words, after applying d, we can now apply the boundary conditions 9; L = 
(Tr Fq) rf in a fashion that makes sense globally on S. After applying this contraction, 
and comparing to the explicit description of d 2 of the spectral sequence from the previous 
section, we see that the action of the BRST operator is the same as the action of d2', de- 
manding that the vertex operator be BRST-closed is equivalent to demanding that it lie in 
the kernel of d>2- 

Thus, in this fashion we see that the spectral sequence relating sheaf cohomology to Ext 
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groups is encoded physically in the BRST cohomology. 



A very careful reader might note that we have glossed over one important point. In sec- 
tion 2.2, we discussed how the Freed- Witten anomaly tells us that the sheaf i*£ corresponds 
to a D-brane with worldvolume gauge bundle £ ® \J-Kg. The Chan-Paton curvature men- 
tioned above is the curvature of the twisted bundle £ <g> \J Kg, yet the curvature appearing 
in the evaluation map inside d 2 is the curvature of the bundle £ . This is consistent for the 
following reason. The curvature of £ <g> \J Kg can be expressed as the curvature of £, plus an 
extra term determined by the first Chern class of Kg. However, that extra term drops out 
of the d 2 computation. 

This can be seen readily from our computation of d 2 in Section 3.4.2. We have interpreted 
the d 2 term as an obstruction, but the bundle TS is unobstructed for any deformation of 
S; that is, TS deforms for free with any deformation of S. So d 2 must vanish if the gauge 
bundle is TS. Furthermore, a general d 2 is given by multiplying a coboundary map like (6) 
with the curvature of the gauge field. But the curvature of the twisted gauge field is equal 
to the curvature of the original gauge field plus half of the curvature of TS, and we have 
just observed that multiplying by the curvature of TS gives zero. Thus, that extra term 
is irrelevant for d 2 , and so it does not matter whether we use the curvature of £, or the 
curvature of £ <g> J Kg. 




In this section we have described how the spectral sequence can be realized physically, 
in the special case that the Chan-Paton gauge fields on either side of the open string are 
the same. In principle, of course, one would also like to check that the spectral sequence is 
realized physically more generally. We hope to address this in future work, as this seems 
extremely plausible. 

4 Parallel branes on submanifolds of different dimen- 
sion 

4.1 Basic analysis 

For another class of examples, consider a set of branes wrapped on i : S X, with gauge 
fields defined by holomorphic bundle £ , and another set of branes wrapped on j : T <— > S 
X, with gauge fields determined by bundle T . Following the same analysis as above, and 
ignoring the twisting of [13], we find boundary Ramond sector states given by 



where the 77 indices are tangent to T, and the 6 indices are normal to S X. Note that 
since the fields must respect the boundary conditions on either side of the operator, there 




a/3jyj; 



m 
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can be no fields with indices in N T /$, as any such 77 fermions would be killed by boundary 
conditions on one side, and any such 6 fermions would be killed by boundary conditions on 
the other side. Equivalently, if we think about fermions on an infinite strip, fermions with 
mixed Dirichlet, Neumann boundary conditions are half-integrally moded, and so cannot 
contribute to massless modes in the Ramond sector (where the zero-point energy is already 
zero). The only possible factors can come from fermions with only Neumann or only Dirichlet 
boundary conditions; hence, the vertex operators above couple to the tangent bundle of T 
and to Ns/x, but not Nt/s- These vertex operators are in one-to-one correspondence with 
bundle-valued differential forms, counted by the (sheaf cohomology) groups 

H n (T, (£\ t ) v ® T <g> A m N s/x \ T ) . (12) 

Again, we are here ignoring the boundary condition twisting described in [13]. 

We should mention that our expressions for sheaf cohomology groups describing modes 
of open strings connecting parallel branes of different dimensions do not assume that the 
difference in dimensions is a multiple of four. If the difference in dimensions is not a multiple 
of four, then in a physical theory, supersymmetry is 5 broken - although the Ramond sector 
ground state will always have vanishing zero-point energy, it is well-known that only when 
the difference in dimensions is a multiple of four will it be possible to find corresponding 
massless modes in the Neveu-Schwarz sector. However, there are massless modes in the 
Ramond sector for any difference in dimensions, and also corresponding BRST-invariant 
TFT states for any difference in dimensions. 

As in the last section, one would hope that these open string states should be related to 
global Ext groups of the form 

Ext^ (uSj^J 7 ) 

where i : S <^-> X and j : T X are inclusion maps. As before, we have a minor puzzle, 
in that the open string states are not counted by such Ext groups, but rather by the sheaf 
cohomology groups (12). As before, the resolution of this puzzle is that there is a spectral 
sequence relating the sheaf cohomology groups (12) counting the open string vertex operators 
to the desired Ext groups. Specifically, there is a spectral sequence generalizing (5) as follows: 

E p 2 ' q = H p (T, S v \ t ®F® A q Ns/x\ T ) Ex4 +9 (i*£,j*f) . (13) 

(See appendix A for a derivation.) 

It is plausible to assume that, as in the last section, when the Chan-Paton-induced 
boundary condition twisting described in [13] is properly taken into account, the effect will 
be to realize the spectral sequence above physically in the BRST cohomology, so that the 

5 Tcchnically speaking we are discussing 'undissolved' branes, not 'dissolved' branes. If the second brane 
is not really a second boundary condition on the open string, but only merely curvature in the Chan-Paton 
bundle, then of course the difference in 'dimensions' need not be a multiple of four. 
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states of the massless Ramond sector spectrum will be in one-to-one correspondence with 
Ext group elements. We would like to check this explicitly in future work. For the rest of 
this section, we shall describe the vertex operators in terms of sheaf cohomology groups, 
and leave explicit checks of the physical realization of the spectral sequence above to future 
work. 

Let us now look for an example where the spectral sequence (13) is nontrivial and T ^ S. 
If we are to have a nontrivial d r with r > 2 then clearly some 

= H p (T,£ y \ T ®F® WN s/ x\t) 

with p > 2 must be nonzero. In particular, it must be the case that dim(T) > 2. Since T is 
a proper subset of S, it must be the case that dim(S') > 3. But if dim(S') = dimX = 3, then 
Ns/x = 0, hence E%' q = for all q > 1, and again the spectral sequence must degenerate. 
The conclusion is that nontrivial spectral sequences (13) can occur only if dim(X) > 4. 



4.2 Example: ADHM construction 

As a quick check of our spectrum computation, let us check that our description in terms 
of sheaf cohomology groups correctly reproduces details of the ADHM construction. For 
k D5-branes on N Z)9-branes, say, one should expect to recover a single six-dimensional 
hypermultiplet valued in (k,N) of U(k) x U(N), and a single hypermultiplet valued in the 
adjoint of U{k). Assume T is a point on a K3 surface S = X (so N s /x is trivial), and £ , T 
are both trivial, then the only nonzero sheaf cohomology is 

H°(pt,(£\ T ) v ®F) = C kN (14) 

from open strings of one orientation between the D5 and D9 branes, determining 



Ext (i*£, 



C kN 71 = 0, 
n ^ 0, 



a well-known mathematical result, and also 

H° (pt, J= y ® T) , H° (pt, J= y ® T ® N T/X ) , H° (pt, J= y ® T ® A 2 N T/X ) (15) 

from our previous analysis applied to strings connecting D5 branes to D5 branes. 

Now, in a physical theory these sheaf cohomology groups are counting massless fermions, 
so from (14), we see we get a single (k, AQ-valued fermion in six dimensions. This is precisely 
the fermionic content 6 of a six-dimensional hypermultiplet valued in (k, N) of U{k) x U(N). 

6 Rccall that a single six-dimensional Weyl fermion is equivalent to a pair of "symplectic-Majorana" Weyl 
fermions, which allow us to write the supcrsymmctry transformations in a form some readers might find more 
familiar. Put another way, in order to get a pair of four-dimensional Weyl fermions after compactification 
on T 2 , one must have started with a single six-dimensional Weyl fermion. 
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The set of states (15) from open strings connecting D5 branes to D5 branes, precisely 
describe the fermion content of the six- dimensional gauge multiplet, a C/(A;)-adjomt-valued 
hypermultiplet, and their antiparticles. (The antiparticles of the D5 — D9 string states are 
given by strings with opposite orientation, as we will be able to check later after doing the 
general case which includes in particular the situation S C T arising when the opposite 
orientation is chosen.) 

Now, in closed string theories, the GSO projection uniquely determines the type of low- 
energy field (e.g., chiral multiplet or vector multiplet) from the U(l) charge of the vertex 
operator. In particular, vertex operators of U(l) charge one correspond to low-energy chiral 
multiplets in compactifications to four dimensions. With that in mind, it would be natural 
to assume that the degree of the Ext group determines the type of low-energy field, in the 
same way. In other words, it would be natural to assume that a field associated to a vertex 
operator corresponding to an Ext group element of degree one (or whose Serre dual has 
degree one) should correspond to a chiral multiplet, and so forth. 

Unfortunately that naive assumption is not true in general, as we see in this example. 
Specifically, in this ADHM example the hypermultiplets are coming from Ext groups of 
degree zero, not one. (We are describing Ext groups on K3's, but the problem persists even 
after performing the obvious further compactification on T 2 , as we shall check shortly.) Thus, 
we see explicitly in this ADHM example that such a hypothetical correspondence between 
degrees of Ext groups and type of matter content simply does not hold in general. Here, our 
hypermultiplets are coming from Ext groups of degree zero, not one. 

Note that we have not used any results from this paper in making this observation. Also 
note we are not claiming that scalar fields are never associated with Ext groups of degree 
one in nontrivial cases. For example, in the next section, we shall see a nontrivial example 
in which the scalar fields are associated with Ext groups of degree one. Note furthermore 
that this ADHM example is not the only example in which this naive mismatch occurs. 
For example, in work to be published shortly we shall see that the same problem arises 
when describing configurations of D5 branes and D9 branes on orbifolds, as relevant to, for 
example,the ADHM/ALE construction. 

There are several possible resolutions of this discrepancy. One possibility is that the U(l) 
charge of a state and the degree of the Ext group do not match, perhaps via (fractionally) 
charged vacua. (This has also been suggested by others; see e.g. [3].) Perhaps the states 
have U{1) charge one, and non-matching Ext degree. Of course, it would be absurd to then 
claim that the corresponding Ext groups are actually of degree one just because of their 
U{\) charges, as those degrees are uniquely determined mathematically and, in fact, are 
well-known. In this paper we have specifically avoided talking about U(l) charges of states, 
so as to avoid having to sort out such issues. We do not intend to try to give a definitive 
account of the resolution of this puzzle in this paper. 
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Instead, we merely wish to observe, based on this very clean example, that in general the 
type of matter content is obviously not determined solely by the degree of the Ext group; 
just because an Ext group element is not of degree one does not mean it cannot describe 
scalar states. The correct statement is obviously more complicated. 

Also note that if we compactify the D5 branes on a T 2 , then (14) is replaced by the sheaf 
cohomology groups 



H\T\{E\ T y ®F) = C kN , 
H l {T\{£\ T y ®T) = C kN 

in one open string orientation, corresponding to 



Ext^ 3xT 2 {i*£-,3*F) 



C kN 71 = 0,1, 
n > 1, 



respectively, which give us two fermions in the (k, N) of U(k) x U(N), again precisely correct 
to match the fermionic content of four-dimensional hypermultiplets. Note in this case, when 
X has complex dimension three instead of two, one of the matter fields does come from an 
Ext group of degree one, though neither the other, nor its Serre dual, come from an Ext 
group of degree one. 

Again, we shall not attempt in this paper to give a definitive account of the relationship 
between degrees of Ext groups and type of matter field; rather, we merely wish to point out 
that the relationship is obviously rather more complicated than seems to be often assumed. 



4.3 Serre duality invariance of the spectrum 

In this section we shall point out a puzzle involving Serre duality. Ordinarily spectra are 
Serre duality invariant, but in the present case, we shall see that Serre duality invariance is 
naively lost in certain cases. We shall explore this naive loss of Serre duality invariance in 
this section, and in a later section we shall point out how Serre duality invariance is restored 
by an interesting physical effect. 

How does Serre duality act on our boundary vertex operators? In general, we can use 
the relation 7 K T = K s \t <S> A top N T / s . As a result, under Serre duality, 

H n (t, (£\t) v <S> ^ <S> A m Ns/x |t) = H t ~ n (t, ^ <g> £\ T <g> A m ^ /X | T <g> K T )* 

7 This can be derived by taking determinants in the exact sequence — > T(T) — ► T(S)\t — * N T / S — ► 0, 
i.e. (Ks) v \t — Kt ® A top Ns/T- It is also theorem III. 7. 11 in [23], and when T is complex codimcnsion one 
in S, this reduces to the adjunction formula [20, p. 147]. We shall use analogous formulas repeatedly in the 
rest of this paper, but will not give such detailed justification in future. 
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= #*~ n (T, <g> 5 | T <g> A r -"W S/X | T ® A to? W T/5 )* 

where t is the dimension of T and r is the codimension of S in X. In the second isomorphism 
we have used A r N s /x — K s . 

This result is rather interesting, and somewhat unexpected. Ordinarily, the spectrum of 
string states is invariant under Serre duality - not only for the open string boundary states 
for parallel coincident branes that we discussed in the last section, but also in other contexts, 
such as large-radius heterotic compactifications [11]. By contrast, we seem to see here that 
the open string spectrum connecting parallel branes of different dimensions is not invariant 
under Serre duality in general. 

To shed a little more light on this subject, let us try to find a maximal-charge boundary 
vertex operator corresponding to the holomorphic top form on the Calabi-Yau. Such opera- 
tors are deeply intertwined with Serre duality invariance of spectra, and they play important 
roles in Af = 2 supersymmetry algebras. For example, these operators are typically identified 
with spectral flow by one unit; recall spectral flow by half a unit is part of the spacetime 
supercharge. 

As one might have expected by now, we find that such maximal-charge boundary vertex 
operators do not always exist. We can write 8 

A to PT * x ^ A top T*T® A top N^ /s (g) A top N^ /x \ T . 

If A top NT/s is trivial, then the holomorphic top form on the Calabi-Yau determines a section 
h of A top T*T <g> A top N^ /x \ T , and so if £ = O s , T = O t we have a maximal-charge boundary 
vertex operator given by 

T jt+l-jn JJ t t n Q_ 

lb ll-U I '/ U Jt+l U 3n 

where t = dim T and, in this one example, n = dim X. On the other hand, if A top N T / s is 
not trivial, then it is not clear that the holomorphic top-form on the Calabi-Yau determines 
any boundary vertex operator. 

Thus, whenever the line bundle A 1op Nt/s is nontrivial, the spectrum of boundary vertex 
operators appears to lose Serre duality invariance, and there is a corresponding lack of 
a maximal-charge boundary vertex operator induced by the holomorphic top form of the 
Calabi-Yau. In the next section, when we discuss general brane intersections, we shall return 
to this issue. Specifically, we shall find that the presence of this line bundle is a reflection of 
the Freed- Witten anomaly [14] discussed in section 2.2. More to the point, were it not for 
the Freed- Witten anomaly, spectra could not be Serre-duality invariant, and we would not 

8 As mentioned earlier, in general, the restriction of the tangent bundle of X to a submanifold is merely 
an extension of the normal bundle by the tangent bundle and need not split, so in general it need not be 
true that TX\ T = T*T @ N T/S @ N s/x \t- 
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even be able to claim that spectra are counted by Ext groups. We shall discuss this issue in 
more detail in the next section. 



5 General intersecting branes 
5.1 Basic analysis 

Next, consider two branes, both wrapped on complex submanifolds of a Calabi-Yau, inter- 
secting nontrivially. As before, we shall work out the spectrum of boundary Ramond sector 
states. Also as before, since the Ramond sector vacuum has vanishing zero-point energy, 
such ground states are guaranteed to exist, regardless of whether the corresponding brane 
configuration is supersymmetric. 

In the general intersecting brane case we have the additional complication that we must 
now treat branes intersecting at general angles. Previously we have only considered parallel 
branes, so all worldsheet fermions were either integrally or half-integrally moded, depending 
upon boundary conditions. For branes at general angles, fermions can be fractionally 9 moded 
[22], which naively would appear to greatly complicate our calculations. 

A moment's thought reveals that no great complication is introduced. We are calculating 
Ramond sector ground states, and the Ramond sector vacuum has vanishing zero-point 
energy, so there can be no contribution from any fermions whose moding is non-integral. 
Fractionally moded fermions are therefore irrelevant. 

Following the same analysis as before, if S and T denote two intersecting complex sub- 
manifolds of the Calabi-Yau X, with inclusions i, j respectively, and holomorphic bundles 
£, respectively, such that their intersection SC\T is another submanifold, then as before, 
if we assume that restrictions of tangent bundles split holomorphically and that Chan-Paton 
factors have no curvature, then we find boundary states given by 



where the zero modes describe sheaf cohomology on the intersection S (IT, the r\ indices 
are tangent to the intersection S H T, and the 9 indices are normal to both S and T. More 
formally, the 0's are sections of the bundle 



9 The actual calculation in [22] is more nearly appropriate to branes wrapped on special Lagrangian 
submanifolds; however, it is easy to repeat the analysis for branes on complex manifolds at angles, and one 
recovers the same result that the moding is shifted. 




(16) 



N — TX\ SP[T / (TS\ S nT + TT\ SnT ) 



(17) 
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defined on S D T, so the boundary states above are in one-to-one correspondence with 
elements of the sheaf cohomology groups 

# n (SnT,£ v |5nT®^|snT® A m N) ■ (18) 

Proceeding as before, it would be natural to conjecture the existence of a spectral sequence 

= ^(5nT,5 v ] SnT ®J| SnT ®AW) Ext p + q (i*£,j*F). (19) 

Unfortunately, we have a problem - no such spectral sequence exists in general, as we shall 
argue in the next section. After we have demonstrated where our analysis has been slightly 
too naive, we shall describe the physics subtlety that we have glossed over, and describe how 
to correctly count both physical states, as well as the relation between the correctly-counted 
physical states and Ext groups. 

As before, we are also ignoring the Chan-Paton-induced twisting of boundary conditions 
described in [13]. Judging from the case of parallel coincident branes, it is extremely plausible 
that all spectral sequences are realized physically in BRST cohomology, but we are not at 
present able to explicitly perform that check. For the remainder of this section, we shall 
ignore the Chan-Paton-induced boundary condition twisting, and leave the study of its 
effects to future work. 

5.2 Failure of the naive analysis 

The proposed spectral sequence (19) that would be needed to relate the proposed sheaf 
cohomology groups in (18) to the desired Ext groups does not exist in general, as we shall 
now demonstrate. Our counterexample consists of two complex submanifolds S and T, 
intersecting transversely in a point, such that S is a divisor in the ambient Calabi-Yau 
X. Since these are transverse submanifolds intersecting in a point, from the analysis above 
the only possible boundary vertex operators are charge zero operators of the form 6 Q/3 (0 O ), 
corresponding to elements of H° (S fl T,£ v \ S nr ® F\sra)i and hence if the desired spectral 
sequence existed in general, the only nonzero Ext group would be Ext^- (i*£, 

Since S is a divisor in X, we can calculate the Ext groups directly. For simplicity, assume 
that £ = Os and T = Ot- Without loss of generality assume S is the zero locus of a section 
of a line bundle Ox(S), then we have a projective resolution of Os given by 

— O x (-S) — O x — O s — 0. 

Local Extx {Os, Ot) sheaves are given by the cohomology sheaves of the complex 

EQm 0x (°x,0 T ) — EQm 0x (Ox(S),0 T ) 

which we can rewrite as 

O t — > O t (S\ t ). 
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The map above is injective, with cokernel Osnr (S\sdt) — N s / x \snT- Thus, 



so from the local-global spectral sequence we immediately compute that 
Ext£ (O s ,O t ) 



f #°(SnT,7V 5/x | SnT ) n = l 
\ n ^ 1 



(using the fact that S fl T is a point) but this contradicts the claim above, as here we see in 
this example that the nonzero Ext groups all have degree one or greater, whereas in order 
for our conjectured spectral sequence (19) to hold, the only nonzero Ext group must be at 
degree zero. 



5.3 Corrected analysis 

We have a puzzle. Previously, in discussions of parallel branes, we were able to relate 
boundary vertex operators to Ext groups in a reasonably straightforward fashion that worked 
for all parallel brane configurations, both BPS and non-BPS. In the general case, however, 
after repeating the same analysis as before, we find it is not possible to relate our boundary 
vertex operators to Ext groups in the general case. Given our previous success, we must 
surely have made an error in our analysis. But where? 

The resolution of this puzzle lies in the fact that we have neglected the Freed- Witten 
anomaly [14]. Recall from section 2.2 that as a result of that anomaly, the sheaf i*£ corre- 
sponds to a D-brane with bundle S <8> yj Kg on its worldvolume, instead of S. In the present 
case, that means that the states (16) are counted by sheaf cohomology groups on S fl T 
valued in the bundle 

<g> A m N 

SnT 

In other words, because of the Freed- Witten anomaly there is a factor of 



K s 


snr 


K T 


snr 



that we missed previously. 

Now, on the face of it, we do not seem to have improved matters significantly. After 
all, that square-root-bundle is not always an honest bundle, and sheaf cohomology with 
coefficients in non-honest bundles is not well-defined. 




snT 
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The other anomaly discussed in section 2.2 saves the day. Recall that just as the closed 
string B model is only well-defined for Calabi-Yau targets, the open string B model is only 
well-defined when the following 10 line bundle is trivial: 

A top N SnT/s ®A top N SnT/T (20) 



Using the fact that 

A top N SnT/x 9* A top N SnT/s ®A to PN s/x \snT 

SnT 

and the fact that K s = A top N s /x, we see that whenever the line bundle (20) is trivial, i.e. 
whenever the open string B model is well-defined, 



K s 


SnT 


K T 


SnT 


K T 


SnT 


K s 


SnT 



A op N S nT/T 



= A^NsnT/s 

so those square roots are actually honest bundles whenever the open string B model is well- 
defined, and in fact the Freed- Witten anomaly yields new factors in the coefficients of the 
sheaf cohomology groups. 

In other words, taking into account the Freed- Witten anomaly, we see that the boundary 
Ramond sector states (16) are in one-to-one correspondence with elements of the sheaf 
cohomology groups 



H p fl T, £ v |snT <8> F\snT <g> A q - m N <g) A top N S nT/T) 
H p (S fl T,£\ S nT <8> F V \snT ® A^' n N ® A^NsnT/s) 

(depending upon open string orientation) where m = rk Nsdt/t, n = rk Nsdt/s- 



(21) 



Unlike the attempt described above in (18) to associate sheaf cohomology groups with 
physical states, our new sheaf cohomology groups above in (21) are related to Ext groups, 
via the spectral sequences below: 

= H p (SnT,£ v \ SnT ®F\ SnT ®A' 1 - m N® A top N SnT/T ) =}► Ext^ +9 (u£, 
E™ = Hr(SnT : £\snT®F V \snT®Ai- n N®A to i>N SnT/s ) =}► Ext^(j^,^) 



10 Technically this is the condition that applies when TX\s and TX\t split holomorphically and the Chan- 
Paton factors have no curvature, so that the open string boundary conditions are easy. This is the same set of 
conditions for relevant spectral sequences to trivialize, so that Ext groups are the same as sheaf cohomology 
groups we shall obtain shortly. If these conditions are not met, then the open string zero modes are more 
complicated, spectral sequences are nontrivial, and the line bundle (20) is also modified. 
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where m is the rank of N Sn T/T and n is the rank of N S nT/s- Mathematical proofs of these 
spectral sequences can be found in appendix A. 



Note that our example in subsection 5.2 is fixed by taking into account the Freed- Witten 
anomaly. Recall there we considered two branes with trivial bundles wrapped on two trans- 
verse submanifolds S and T, intersecting in a point, such that S is a divisor in the ambient 
Calabi-Yau. From our new analysis (21), the possible boundary vertex operators are classi- 
fied by the single sheaf cohomology group 



H° (SnT,NsnT/ T ) 



(for one open string orientation). Using the fact that N = Ns/x\sr\T/{NsnT/T) and that 
iV = to see that Nsdt/t — Ns/x\snr, we find that the only physical states (in one 
orientation) are naively counted by the sheaf cohomology group 

H° (SnT,N s/x \snT) 
and so the corresponding Ext groups are 

Ext^ (Os, O t ) = { H ° ( S n T ' N s/x\*rr) " = 1 
XK J \ n±\ 

completely agreeing with the computations described in section 5.2. 

Let us check our results in another example. Consider (following [26]) a pair of sets 
of orthogonal D-branes on C 3 , which we shall describe with complex coordinates x, y, z. 
Put N branes on the divisor y = z = in C 3 and k branes on the divisor x = y = 
in C 3 . In [26], it was claimed that open strings stretching between these D-branes should 
form a hyper mult iplet valued in the (k,N) of U(k) x U(N). So, in order to agree, the 
sheaf cohomology groups for one orientation must be two copies of C kN (as four- dimensional 
hypermultiplets contain a pair of Weyl fermions). If we take S to be the worldvolume of the 
first set of branes, and T the worldvolume of the second set, with S a trivial rank iV bundle 
on S and T a trivial rank k bundle on T, then we find that TX\snr/ (TS\snT + TT\sdt) is 
the trivial rank 1 complex vector bundle over S flT (i.e., the origin of C 3 ), corresponding to 
the directions y, y, along which the open string has Dirichlet boundary conditions on both 
sides. Also, Nsdt/s and Nsht/t are both rank one trivial bundles over the point S flT (the 
origin of C 3 ), and so we get two sheaf cohomology groups in each orientation, namely 

H°(SnT,S s/ \ SnT ®F\ SnT ®N SnT/T ) = C kN , 
H° (S nT,£ y \ SnT ® F\snT ® N ® N S nT/ T ) = C 

for one orientation, determining 

Ext^a (i*£, j^J 7 ) = 



kN 
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This is the correct number of states to give a four-dimensional hypermultiplet valued in the 
(k,N) of U(k) x U(N), precisely reproducing the result in [26]. Note that in this case, each 
Ext group (or its Serre dual) corresponding to a matter field has degree one, agreeing with 
current lore, unlike the ADHM example discussed previously. 

As another check, we shall rederive from our (corrected) general analysis our results for 
the case of parallel branes of different dimension. Suppose that T is a submanifold of S. 
Then, in the expressions above, N = TX\ SnT / (TS\snT + TT\sra) = Ns/x\t, N SnT / T = 0, 
and Nsnr/s = Nt/s in this case. Thus, the two spectral sequences (21) reduce to 

E™ = H p (t,£ v \ t ®F®A c >N s/x \ t ) Ext p + q (i*£,j*F) 

E p 2 ' q = H P (T,S\ T ®F V <g> A q - n N s/x | T <g> A n N T/s ) Ext^ +9 i£) 

for n = rk N T / S . The first of these expressions is the first spectral sequence we discussed in 
describing how to generate Ext groups from boundary vertex operators for parallel branes 
of different dimension, and the second we discussed later in that section in connection with 
Serre duality in non-supersymmetric cases. 

Note in passing that there are two families of cases in which the spectral sequences 
below (21) completely degenerate, and Ext groups can be identified canonically with single 
sheaf co ho mo logy groups: 

1. Suppose S and T intersect transversely. In this case, N = as 11 TS + TT = TX 
over S fl T, so E%' 9 = if q ^ rk N SnT / T in the first spectral sequence, and = 
if q ^ rk N Sn T/s i n the second. Hence, the spectral sequences completely degenerate, 
and 

Ext p x (i*£ = { HP ~ m { Sr]T ^ V \snT®J r \snT®A top N SnT/T ) p>m 

1 p < m 



p > n 
p < n 

where m = rk N SnT / T and n = rk N Sn T/s- 

2. Suppose S fl T is zero- dimensional. In this case, E^ = for p ^ in both spectral 
sequences, and so we find 

Ext^ (i*E = I H °( SnT > gV \snT ® F\snT ® A p ~ m N <g> A^iV SnT/T ) p > m 

\ p < m 

Ext p x uS) = I H °( Sf] T > S \snT ® F V \snT ® AP~ n N ® A^iV SnT/s ) p > n 

\ p < n 

with m and n as above. 



11 For transversely intersecting submanifolds, this is usually stated for the tangent bundles as C°° real 
vector bundles; however, it is also true for the associated holomorphic vector bundles we have here. 
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5.4 Restoration of Serre duality invariance 



In section 4 we saw a breakdown in Serre duality invariance of the open string spectra. 
However, at the time we did not take into account the possibility that the boundary vacua 
could be sections of bundles over part of the Calabi-Yau. In this section, we shall see 
explicitly that by taking into account the Freed- Witten anomaly, Serre duality invariance of 
the spectrum is restored. 

How does Serre duality act on our states? The sheaf cohomology groups 

H p (s n T,S v \ SnT ® JF| 5nT ® A q ~ m N <g> A m N SnT/T ) (22) 

are isomorphic to 

H s - p (S l~l T, £\snT <8> ^ V |snr ® A 6 -"+ m iV <g> A top iV v <g> A m A^ nT/T ® if SnT )* 

where 6 = rk iV and s = dim S (IT. Next, use the fact (to be demonstrated below) that 

A top N v ®A top N v SnT/T = A top N SnT/s ®A top N v SnT/x 
so that the sheaf cohomology groups (22) are isomorphic to 

H s - p (S l~l T, £|snT <8> ^ V UnT ® A 6 ^ +m iV ® A top iV 5nr/5 ® A top iV^ nT/x <g> K 5nT )* 

but i^snr — h- top N S nT/x, so we finally see that the sheaf cohomology groups (22) are iso- 
morphic to 

H s ~ p (S l~l T, £|srtr <S> ® A'' " "\Y ® A top iV 5nT /s)* ■ 

Thus, Serre duality acts to exchange the sheaf cohomology groups appearing in our two 
spectral sequences. In other words, taking into account the Freed- Witten anomaly, we find 
that the physical spectrum is Serre duality invariant. 

Let us also determine under what circumstances the holomorphic top form on the ambient 
Calabi-Yau induces a maximal- charge boundary vertex operator. Proceeding as before, we 
have that 

A top T*X\ SnT = A top T*(SnT) ® A top N^ nT/x . 

Next, use the fact that 

A top N S nT/x = A top N S nT/T®A top N T/x \snT 
= A top N SnT/s ®A top N s/x \ SnT 



and as 



N 



TX\snr N s /x\snT N T / x \snT 



TS\ S nT + TT\ SnT N SnT / T N SnT / s 
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we see that 



A top N S nT/x = A top N SnT/T ®A top N®A top N SnT/s 



so finally 



SnT — 



A top T*{SnT)®A top N, 



SnT/T 



v 



<g> A top N, 



SnT/s 



<g> A top N v . 



Thus, if both A top N SnT / s and A top N SnT / T are trivial, then the holomorphic top form on the 
ambient Calabi-Yau is equivalent to a section of A top T*(SnT) <g> A top iV v , which is equivalent 
to a maximal-charge boundary vertex operator 



Of course, by including the vacua in the discussion, we find that if at least one of 
A top N S nT/T, A top N S nT/s is trivial, then one could still get a maximal- charge boundary vertex 
operator induced by the holomorphic top form on the Calabi-Yau. 

Recall in section 4 we ran into an apparent problem with Serre duality. At the time, 
we had not taken into account the Freed- Witten anomaly. Let us take a moment to work 
through the details. First, if T C S, then N SnT / T = 0, so for one string orientation we 
were consistent in section 4 to ignore the Freed- Witten anomaly, and so the boundary state 
analysis in section 4 need not be redone. At the same time, Nsdt/s — Nt/s, so we see i n 
our present language that if A top NT/s is nontrivial, then we would naively run into problems 
with Serre duality, as indeed we saw in section 4. By taking into account the Freed- Witten 
anomaly, we are able to restore Serre duality invariance of the open string spectrum. Thus, 
we have solved the puzzle presented in section 4. 

5.5 Proposal for new selection rule 

In this section, we shall make a proposal for a new selection rule for BPS brane configurations. 
Specifically, we propose that whenever the line bundle 



is nontrivial, the corresponding brane configuration is non-BPS, when working near large 
radius, and when the B field vanishes identically. 

This proposal is motivated by our earlier anomaly computation, that told us when the 
Chan-Paton factors have no curvature and TX\$ splits holomorphically, the open string 
B model is only well-defined when the line bundle (23) is trivializable. Recall this is the 
open string analogue of the statement that the closed string B model is only well-defined for 
Calabi-Yau target spaces. 



lb ll---ls U 3s+1 U 3; 



3n 



A tcrp N SnT/T ® A^Nsnr/s 



(23) 
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Let us check this statement empirically. Suppose S — X, which is taken to be a Calabi- 
Yau threefold with holonomy precisely equal to SU(3) (so in particular X is not T 6 or 
K3 x T 2 ). Let T be a curve in X, other than an elliptic curve. In this case, A top N S nT/T is 
trivial, but A top Ns<-\T/s — A top Nx/s is nontrivial, so according to our analysis in section 2.2, 
the open string B model is not well-defined in this case. If this brane configuration is 
super symmetric, then we appear to have a problem. Now, the difference in dimensions 
between S and T is a multiple of four, so naively this brane configuration appears 12 to be 
BPS. However, the ambient Calabi-Yau breaks too much supersymmetry. After all, in a type 
II compactification, the ambient Calabi-Yau leaves one with only M = 2 supersymmetry in 
four dimensions, which is broken to M = 1 by the first brane. However, M = 1 has no 
BPS states, so a second non-coincident brane cannot be a BPS configuration. 13 Thus, these 
two branes for which the open string B model is not well-defined, are also not mutually 
sup er sy mmet r ic . 

Similarly, if S — X, a Calabi-Yau threefold as above, and T is a divisor in X, then 
A top N S nT/T is trivial, but A top N SnT / s = K T is nontrivial (unless T is itself Calabi-Yau) and 
again the brane configuration appears to be generically non-BPS, although this time the 
reason is much more basic, namely the difference in dimensions is not a multiple of four. 
Thus, we have another example where the open string B model is not well-defined, and the 
corresponding brane configuration is non-BPS, consistent with expectations. 

In every example of which we are aware in which the brane configuration is BPS, the 
line bundle A top NsnT/T <8> A top NsnT/s is trivializable, so that the open string B model is 
not anomalous. For example, consider parallel coincident branes i.e., S = T, then both 
NsnT/s — and N Sri T/T = 0. Similarly, if T is a point on S = X = K3, then again 
both A top N S nT/T and A top N S nT/s are trivial, consistent with the fact that the corresponding 
branes are mutually supersymmetric. 

Note also that it is possible to have non-BPS configurations such that the line bundle 
A top N sot /t ® A top N S nT/s is trivializable - we are claiming that this line bundle defines a 
sufficient but not necessary condition for a brane configuration to be non-BPS. For example, 
if S — X and T is a divisor that is also itself a Calabi-Yau manifold, then A top NsnT/T <8> 
A top N Sn T/s is trivial, yet this is clearly a non-BPS configuration for dimension reasons. So 
we are not conjecturing that a brane configuration is supersymmetric if and only if both 
of those line bundles are trivial. Rather we are only making the weaker conjecture that if 
A top NsnT/T®A top N S nT/s is nontrivial, then close to large radius, with zero B field, the brane 
configuration will not be BPS. 

12 Precisely at the large radius limit point, this brane configuration is BPS. Our remarks involving curvature 
of the ambient space are irrelevant at the limit point, as the space has become infinitely large and curvature 
has spread infinitely thin. However, if one is interested in results merely near large radius, not actually at 
large radius, then our curvature considerations become important. 

13 It is possible in principle for S and T to preserve precisely the same supersymmetry hence be mutually 
BPS, although this is clearly non-generic. Our assertion is that this can only happen if T is an elliptic curve. 
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6 Nonintersecting branes 



In this section, for completeness we shall very briefly discuss boundary spectra describing 
open strings between D-branes on two completely disjoint complex submanifolds of a Calabi- 
Yau manifold X. Let the two submanifolds be denoted Si, S 2 , say, with inclusion maps i±, 
i 2 , respectively. 

In this case, if the two complex submanifolds are completely disjoint, then there are no 
massless open string states connecting them. Happily, it is also easy to check that in such 
circumstances, all the groups 

Ext^ (iuSi,i 2 *S 2 ) 

must vanish. We can check this by noting that if there are no points on X where at least 
one of i 2 *£ 2 are zero, then all the corresponding local Ext sheaves must vanish, and so 
by the local-global spectral sequence, the global Ext groups must all vanish as well. 



7 Ext groups of complexes 

Another claim commonly made concerning the relationship between D-branes and derived 
categories is that if open strings with boundaries corresponding to two complexes should 
have open string modes counted by Ext groups. In other words, for an open string strip 
diagram, if S. is a complex describing one boundary, and T. is a complex describing the 
other boundary, then open string modes should be counted by elements of 

Ext£ w (£-,?■) = # n RHom (£.,F.) 

One can ask how these groups are realized physically, just as earlier in this paper we 
asked how Ext groups between coherent sheaves could be realized physically. We saw how 
Ext groups between coherent sheaves are realized by vertex operators. What is the analogous 
procedure for Ext groups of complexes? 

We shall consider simple configurations involving only branes, no antibranes. We will 
find that boundary vertex operators can be used to determine countably many possible Ext 
groups between complexes. It is tempting to conjecture that this ambiguity is closely related 
to possible reinterpretations of this calculation in terms of brane/antibrane configurations; 
however, we shall not say anything further here. 

Let us consider the simplest possible nontrivial case, in which 
£.:■■■ — ► — > £ 1 S 2 — > — 
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i 



T 



E 

2 



F 

Figure 1: Open string realizing map between simple complexes. 

and 

— ► — ► Tx — > — 

so £. has only two nonzero elements, and T. has only a single nonzero element. The corre- 
sponding open string diagram is shown in figure (1). 

Now, how can we see the states counted by Ext(£., JF.)? We shall loosely follow the 
analysis of [27]. The only boundary degrees of freedom are the asymptotic incoming and 
asymptotic outgoing states. A state coming in asymptotically from the left of figure (1) would 
only see boundaries £\ and JF; both £2 and the boundary operator T would be effectively 
invisible. Hence, assuming for simplicity that £\ and T are both bundles on the same 
submanifold S of the Calabi-Yau X, our earlier analysis tells us that the asymptotic incoming 
states are naively counted by the sheaf cohomology groups 

H n (s, £^®^® A m N s/x ) 

which determine (via a spectral sequence) elements of 

Ext^ +m (uSuuJ^. 

Similarly, the asymptotic outgoing states (on the far right) only see £2 and JF, and so are 
naively counted by the sheaf cohomology groups 

H n (S,£^(g)F(g) A m N s/x ) 

which determine a corresponding Ext group. 

Now, these asymptotic states determine an element of the desired group 

Ext n D(x) {£.,?.) 

as follows. First, note that there is a short exact sequence of complexes 

— ► £ 2 — > £ — ► £i[l] — ► (24) 
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an immediate consequence of the following trivial commuting diagram: 
0: ^0 ^0 ^0 ^0 



-'2 • 



£ : 







• — >- £ 2 • 



■0 — *£i— -+£2 — -0- 



• £1 — > — >■ • 



















As a result of the short exact sequence (24), we have a long exact sequence of Ext groups 
given by 

••• — Ext£ w (£i[l],.F.) — Ext£ w (£,.F.) — Ext£ w (£ 2 , T) — > 
— ErtSfi)(ft[l],^) — > ••• 

For the complex JF. described above, we can simplify these expressions. The simplification 
depends upon the relative grading of £. and T.. In the special case that T\ and £ 2 have the 
same grading 

Ext n D(x) (£ 2 ,F.) = Ext x (£ 2 ,^) 
Ext^ (x) (^[l],^.) = Extr 1 ^!,^) 
so we can rewrite the long exact sequence above more usefully as follows: 

... — Extr 1 ^!,^) — ExtS, w (5.,^i) — Ext^,^) — 
— Ext^,^) — ••• 

More generally, if the grading of JF X is shifted j units to the left of £ 2 , then 



Ext 



D(X) 



(£ 2 ,F.) = Ext^(£ 2 ,^ 



Ext£ w (£i[l],.F.) = Extr 1+J '(^i,^i) 
in which case we can rewrite the long exact sequence as 

••• — Extr 1+J '(£i,^i) — Ext£ w (£,.F.) — Ext^' (52,^) 
— Ext^'^,^) — ••• 



Thus, we see that boundary vertex operators can be used to determine Ext groups be- 
tween complexes, but there is an ambiguity in the grading. 
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8 Conclusions 



In this paper we have explored recent claims that, for D-branes wrapped on complex sub- 
manifolds of Calabi-Yau's, open string states between D-branes are counted by Ext groups. 
We have given much more detailed checks of this claim than have appeared previously, and 
have worked out vertex operators corresponding to Ext group elements in some generality. 

In general terms, we have found that naively massless states in the Ramond sector of open 
strings between intersecting D-branes (wrapped on complex submanifolds, near large radius, 
with zero B field) are in one-to-one correspondence with sheaf cohomology groups, which are 
related to the desired Ext groups via spectral sequences. We have checked in a subclass of 
cases that those spectral sequences are realized physically via BRST cohomology, ultimately 
because of a Chan-Paton-induced modification of the open string boundary conditions [13]. 
We conjecture (though have not been able to explicitly check) that the same is true in general, 
that in all cases, the spectral sequences are realized physically in BRST cohomology, so that 
in general, massless Ramond sector states are in one-to-one correspondence with Ext group 
elements. These spectral sequences are nontrivial in general, in the sense that the unsigned 
sum of the dimensions of the sheaf cohomology groups is not the same as the unsigned sum of 
the dimensions of the corresponding Ext groups, so understanding their physical realization 
is an important issue. 

For parallel (but not necessarily coincident) branes, relating boundary vertex operators 
to Ext group elements is straightforward physically. However, for more general brane inter- 
sections, we find a more interesting story. Specifically, we found that in order to be able 
to relate boundary vertex operators to Ext groups, we have to take into account the Freed- 
Witten anomaly, which forces the gauge bundles on D-brane worldvolumes to sometimes be 
twisted into non-honest bundles. Not only does this allow us to find a relationship with 
Ext groups, but it also fixes a naive breakdown in Serre duality invariance of the spectrum. 
Finally, we point out that a separate anomaly in the open string B model, the open string 
analogue of the statement that closed strings are only well-defined on Calabi-Yau's, yields a 
new (and very obscure) selection rule for BPS states. 

In future work, we hope to return to the issue of the physical realization of the spectral 
sequences in the remaining cases. We conjecture that those spectral sequences are realized 
physically via BRST cohomology, so that the massless Ramond sector states are in one-to- 
one correspondence with Ext group elements, but we have only checked this explicitly in the 
case of parallel coincident branes. 
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A Derivation of spectral sequences 

In this appendix, we give rigorous derivations of the spectral sequences that are used in the 
paper. 

A.l Parallel coincident branes 

Let X be a complex manifold. In our applications, X will be Calabi-Yau but this is not 
necessary so we do this more general situation which could conceivably be of interest for 
more general topological string theories than have been considered here. 

Let S be a smooth complex submanifold of X, and let % : S X be the inclusion. 
Finally, let £ and T be bundles on S. The goal of this section is to compute Ext^~ q (i*£ , i^J 7 ), 
verifying the spectral sequence (5) which we reproduce here for convenience: 

E p > q : H p (s, £ v <g> T <g> A q N s/x ) Ext p + q 

The method is to compute the local Ext sheaves Ext *(a«£, i*T) (which are supported on 
S) , and then use the local to global spectral sequence 

H p {X,Ext q {i*£,i*F)) Ext p ^ q {i,£,i,r). (25) 

Note that H P {X, Ext q {i*£, uF)) = HP(S,Ext 9 (LS,LF)) when Ext q (nS, LF) is viewed as 
a sheaf on S. 

Since 

Ext q (i*£, = Ext q (i*O s , i*O s ) £ v ® T, (26) 

we can and will assume temporarily that £ and T are both Og- Since S is smooth, it is 
a local complete intersection [20, P. 20], so we can work locally and assume that S is the 
zero locus of a regular section s G H°(E) where E is a bundle on X. We will eliminate 
dependence on E in the results by noting E\s — N$/x, as will be verified shortly. 
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We have the Koszul resolution 

-> ► A 2 E* -> -> C x -> i„O s -> (27) 

where all maps except the last restriction map are defined as contraction by s. Explicitly, 
the map A q E v — > A q_1 E y is given by 

(ui A ... A c<jg) i— > y^(— l)- 7-1 ^,^)^! A ... A c<jj_i A c<jj + i A . . . Au q . 

The Koszul complex (27) is exact if and only if s is a regular section, i.e. if and only if the 
rank of E is equal to the codimension of S in X. See [20, 28]. 

For later use, note that (27) omitting Ox is self-dual up to a twist: if E has rank r so 
that A r E is a line bundle, then A k E ~ A r ~ fc £* <g> (A r E). See [28, Proposition 17.15]. 

We can truncate (27) to obtain the surjection 

E* - J 5/x - (28) 

where X s /x denotes the ideal sheaf of S in X. Tensoring (28) with iJDs = Ox/(Zs/x) wc 
get the surjection E*\ s — > X s /x / i^s/x) 2 which can be seen to be an isomorphism by using 
local equations for S in X. Since I s /x /(^s/x) 2 — Ng, X: we see that E\ s ~ N s /x as claimed. 

We use (26) and (27) to calculate Ext @ (i*£, i^J 7 ) as the cohomology sheaves of the 
complex 

(A*E®£ V ®f)\ s . (29) 

Note that s\s = by construction, so all maps in (29) are 0. Combining with E\ s ~ N s /x, 
we get 

Extp x UT) ®T® A q N s/x . (30) 

Then the claimed spectral sequence (5) comes from substituting (30) into the local to 
global spectral sequence (25). 

This spectral sequence has previously appeared in the string theory literature, e.g. [29]. 
A. 2 Parallel branes of different dimension 

In this section we shall derive the spectral sequence (13) which we reproduce here for con- 
venience: 

E p 2 ' q = H p (T } 8 y \ T ®^®k q N s /x\T) Ext p + q (i*£j*F). 
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Here T is a complex submanifold of S, which is a complex submanifold of X, £ is a holo- 
morphic bundle on S, T is a holomorphic bundle on T, and i : S X, j : T X are 
inclusions. 

Now, recall that we can relate local Ext sheaves to global Ext groups by the local to 
global spectral sequence generalizing (25) 

E™ = H p (S,Ex& s (Si,S 2 )) Extf q (S 1 ,S 2 ) (31) 
which is valid for any coherent sheaves Si,S 2 on S. 

To derive the result formally we shall first show how to compute local Ext sheaves in 
terms of analogous data, then apply the local-global spectral sequence (31). 

As in the previous section, we can work locally and assume that S is the zero locus of a 
regular section s of a bundle E on X. Then we have the Koszul resolution of S - 

■ ■ ■ — > A 2 E V — > E v — > O x — > i*£>s -> 0, 

where i? is a holomorphic bundle on X of rank equal to the complex codimension of S in X, 
with a section s whose zero set is S. The bundle E also has the property that E\ s = Ng/x- 

To compute the sheaf Ext ^ (i*Os, , we use the Koszul resolution above to provide 
a projective resolution of Os- Thus, the local Ext sheaf desired is the degree q cohomology 
sheaf of the complex 

Eom 0x {O x ,]*r) — > Eom 0x (E v ,j*F) — > Hom 0x (k 2 E\ 3 ^) 

Since j*^ 7 is supported onTc5 and s|s = 0, again we have that all maps are and so 

Ext^ x (i*O s ,j*F) = j*Hgm OT (A q N% /x \ T , T) ~ A 9 X 5 /x| T ® 

Locally on X we can form a bundle £ such that £\s = £, and by tensoring the projective 
resolution of Os with £ and repeating the analysis above we immediately get the result 

Ext^ x (i.£, = j;Hom OT (S\ T ® A«/V£ /X | T , .f) = j # ((£ v ® X 5/x ) | T ® .f) . 

Finally, using the result [23, Lemma III. 2. 10] that 

H*(X,j*F) = H*(T,F) 

we see that 

H p (X, Ext 9 (n£,j*F)) = H p (T, (£ v ® A m X s/ x) |t ® J 7 ) 

which together with the local-global spectral sequence tells us that we have the desired level 
two spectral sequence 

E™ : iP (T, (£ v ® A m X 5/x ) | T (g) .f) Ext^ +9 ■ 
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A. 3 General brane intersections 



Let's now turn to the general case. We have to interpret (29), which up to tensoring with 
bundles is the dual of a Koszul complex on a (not necessarily regular) section s of E^j^Or = 
E\t- Koszul complexes are exact over the locus where the section is regular, so in particular 
(29) is exact on the complement of SC\T. In other words, the cohomology sheaves of (29) are 
supported on S H T as was already clear geometrically since these compute Ext * (i*E, i*F). 

If we restrict (28) to T we again get a surjection 

E*\t — > 1srrr,T — > (32) 

but the restriction of (32) to S D T, i.e. E*\snT ^(sr\T)/T^ while certainly a surjection, 
need not be an isomorphism. Since E\s — Ns/x this further restriction of (32) leads to a 
surjection N* s/x \ Sn T -> ^ ( * 5nT)T . Letting N = (N s /x)\snT and N' = N Sn T/T, this can be 
rewritten as a surjection N v — > (iV') v . Dualizing, we see that N' is a subbundle of N. 14 

Denote the codimension of S H T in T by k. Since considerations are local we can and 
will assume that s\t is a section of a rank A; subbundle E' C -E|t whose restriction to S D T 
is the subbundle AT' C iV. Note that s|t is immediately seen to be a regular section of E' 
since its zero locus S f]T has codimension k. 

So we see that (29) is up to tensoring with bundles the dual of a Koszul complex on 
a section of E\ T which is regular as a section of the subbundle E' . Let N — N/N' be the 
bundle on SC\T introduced in (17). We claim that the q th cohomology of this Koszul complex 
is A fc (iV) <g> A"- k N, so that !M q (i*OsJ*0 T ) = A k (N') ® A q - k (N). Thus 

Ext q (i*£,j.F) = A k (N')®A«- h (N) ® (£\ SnT y ® F\ SnT . (33) 

Then (33) immediately leads to the spectral sequence claimed in Section 5.3 by considerations 
of vertex operators. 

It remains to explain our claim. This is justified by linear algebra and local coordinates. 

Rather than give a careful proof, we content ourselves with explaining the idea. We can 
do this most easily if we assume that E\ T splits holomorphically into a direct sum E' © E" 
with E"\snT ^ N. 

The only cohomology of the Koszul complex A'(E') V is on the far right giving OsnT- So 
the only cohomology of the dual complex A'E' is on the far right; by the self-duality we have 

14 The inclusion N' C N can also be seen directly from geometry. Consider the natural composition 
■0 : T(T)\snT — * T(X)\snT N oi the natural inclusion and quotient. The kernel of ip at p e SOT consists 
of T P T n T P S; but this is T p (Sf]T) since SOT is a submanifold. So T(T)|snT/ker(?/>) ~ N' and we have the 
claimed inclusion N' C N. 
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mentioned earlier, we use A*E' ~ A*(E') V ® A k E' to compute the cohomology of the dual 
complex as A k E'\ Sn T = A h N'. 

Now using the full bundle E rather than E', we note that 

A«E\ T = A l E' <g> A q ~ l E". (34) 

i 

The dualized Koszul complex then decomposes into a direct sum of the dualized Koszul 
complex on E' tensored with various A*E". Computing cohomology and using E"\ S nT — N, 
we get A k (N') ®A q ~ k (N). Then we tensor with (Slsnr)* ®F\snT to arrive at (33) as claimed. 

For the general case, we can show that A p E\t has a natural filtration with graded quo- 
tients A^'^Ap-^EIt/E'). Its restriction to SnT is again A^N') ^A^N). This filtration 
can be used to modify the argument that we gave above. 

As an interesting aside, note that this spectral sequence is closely related to a standard 
adjunction calculation in algebraic geometry. For any complex manifold Y, if Z is a complex 
submanifold of complex codimension r, then it is straightforward to show [20, section 5.3] 
that 

ml Y (0 Z ,Ky) = | R ° z (35) 

This also follows readily from our computations above. By taking determinants in the 
exact sequence 

0^T(Z)^T(Y)\ z ^N z/Y ^0 

we see that K z ~ {K Y )\z <8> A top N z / Y . We now can compare (35) to (33) with S = Z, 
T = X = Y,S = O z and T = K Y . Then S n T = Z, N' = N z/Y , and N = 0. Then (33) 
becomes precisely (35) for q < r. 
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